Data Engineer

MasterControl Inc
MasterControl Inc

Job Overview

About MasterControl:MasterControl Inc. is a leading provider of cloud-based quality and compliance software for life sciences and other regulated industries. Our mission is the same as that of our customers to bring life-changing products to more people sooner. The MasterControl Platform helps organizations digitize, automate and connect quality and compliance processes across the regulated product development life cycle. Over 1,000 companies worldwide rely on MasterControl solutions to achieve new levels of operational excellence across product development, clinical trials, regulatory affairs, quality management, supply chain, manufacturing and postmarket surveillance. For more information, visit MasterControl we are building our next generation data platform that will leverage AI/ML techniques to help redefine how our customers bring lifesaving and lifechanging products to market. To enable this, we need your help building our data pipeline, DataMart and data lake.You will be responsible for implementing the data life cycle consumption from the data source to the end model. By gathering requirements from Product, you will transform data in near real-time which will be consumable by AI model training, business intelligence analytic tools, and self-service platforms. You will need a strong emphasis on data modeling, as well as proficiency in data transformation. You will be responsible for integration into the CI/CD pipeline as well as unit and integration testing of all processes. You will need experience with structured, semi-structured, and unstructured data sources. You will need a bachelor’s degree in a STEM related field, or equivalent experience. You will have some work experience with and a passion for Big Data.Responsibilities* Pull data from all customer databases into S3 and put into a queryable format* Model the data for optimal performance (ETL, star-schema like, ORC, partitioning, etc …)* Pull data from a real-time streaming architecture (Kafka) and do near-real-time aggregations and projections of the data, storing the results in S3* Help automate the provisioning of AWS Lake Formations, EMR/Spark/S3 and other services in AWS* Analyze data to find patterns worthy to expose to the end-user* Help tie corporate data to customer data from an OLTP store* Help us discover ways to use Big Data technologies in a Machine Learning pipeline (discover, clean, label, train, test)* Other assigned dutiesPreferred Skills* Scala/Python/SQL/Java* Apache Spark with EMR and/or other Big Data tools* Kafka Streams experience is big plus* Airflow experience is a plus* Big Data Mindset (Spark/Hive/Hadoop/HCatalog/Hudi). Understanding of the Big Data landscape.* Warehouse Architectures (Star Schema/Snowflake/Vaults/Lakes)* Familiarity with AWS and Cloud Formation or Terraform* Data Modelling* ETL Best Practices* Passionate about creatively solving business problems.* Effectively prioritize and execute tasks in a high-pressure environment.* The ability to non-emotionally coach and mentor others.* The ability to not participate in ‘techno-arrogant’ conversation.* Meet multiple, challenging deadlines while communicating expectations clearly.Physical Demands and Working Conditions* Must be able to work well with people.* Ability to operate a computer and work at a desk for extended periods of time.* Ability to communicate effectively in writing, in person, over the telephone and in e-mail.Why Work Here?#WhyWorkAnywhereElse#ExceptionalTeamCultureMasterControl is a place where Exceptional Teams come together to do their best work. Hiring Exceptional Teams, including the best talent in our industry, is a core value of ours. MasterControl employees are surrounded by intelligent, motivated individuals every day. We like to call it #TheBestTeamOnThePlanet.We value every employee and their contribution to what makes MasterControl successful. We give right back to the employee through a generous benefits package, great flexibility, and continuous opportunities for advancement.Not only do we hire Exceptional Teams, but we work hard to keep them here by developing and challenging their skillsets, encouraging professional development and growth, and offering a culture that can’t be found elsewhere. Which is why we say – #WhyWorkAnywhereElse?To put it simply, working at MasterControl is fun, challenging, and rewarding. From our Fitness Clubs to our awards programs, from our company parties to our competitive benefits, you can’t really go wrong. MasterControl could be your next (and last) career move!We are growing quickly and always looking for talented individuals to add to #TheBestTeamOnThePlanet!Here are some of the benefits MasterControl employees enjoy:* Generous PTO package of three weeks, increasing after just three years of employment* Competitive compensation with annual merit increase reviews* 100% medical premium coverage (yes, you read that right!)* Dental/Vision Plans* 401k Plan* Employer Paid Life Insurance Policy ($50K)* Great Flexibility* Wellness Programs (every employee gets a Fitbit!)Applicants must be currently authorized to work in the United States on a full-time basis.

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.