Principal Data Engineer

Apex Systems
Apex Systems

Job Overview

Our client is looking for a Principal Data EngineerArchitect for their office in Durham, NC. Candidates should have architect level experience with PythonSparkAWSData Lakeetc. If qualified, please send your resume to Madison at ! Principal Data Engineer The Principal Data Engineer will work closely with senior engineers, data scientists and other stakeholders to design and maintain moderate to advanced data models. The Data Engineer is responsible for developing and supporting advanced reports that provide accurate and timely data for internal and external clients. The Data Engineer will design and grow a data infrastructure that powers our ability to make timely and data-driven decisions. Job Description bull Extract data from multiple sources, integrate disparate data into a common data model, and integrate data into a target database, application, or file using efficient programming processes bull Document, and test moderate data systems that bring together data from disparate sources, making it available to data scientists, and other users using scripting andor programming languages bull Write and refine code to ensure performance and reliability of data extraction and processing bull Participate in requirements gathering sessions with business and technical staff to distill technical requirement from business requests bull Develop SQL queries to extract data for analysis and model construction bull Own delivery of moderately sized data engineering projects bull Define and implement integrated data models, allowing integration of data from multiple sources bull Design and develop scalable, efficient data pipeline processes to handle data ingestion, cleansing, transformation, integration, and validation required to provide access to prepared data sets to analysts and data scientists bull Ensure performance and reliability of data processes bull Define and implement data stores based on system requirements and consumer requirements bull Document and test data processes including performance of through data validation and verification bull Collaborate with cross functional team to resolve data quality and operational issues and ensure timely delivery of products bull Develop and implement scripts for database and data process maintenance, monitoring, and performance tuning bull Analyze and evaluate databases in order to identify and recommend improvements and optimization bull Design eye-catching visualizations to convey information to users Hiring Requirements bull Bachelor’s degree in Computer Science or related field or equivalent experience bull 7+ years programmingengineering experience in PythonSparkPySpark, Scala, AWS, Teradata, etc. bull 7+ years of SQL programming skills (Intermediate to Advance SQL programming skills) bull Strong Data Lake experience Must have SAS experience Proven experience leading teams and mentoring less experienced team members Proven ability to architect solutionsPOC’setc. with minimal to no direction bull Experience working in AWS and other cloud technologies bull Demonstrated experience working with large and complex data sets bull Experience with business intelligence tools (Tableau) Hiring Preferences bull Experience with query and process optimization bull Ability to translate taskbusiness requirements into written technical requirements bull Reliable task estimation skills bull Excellent quantitative, problem solving and analytic skills bull Ability to document data pipeline architecture and design bull Ability to collaborate effectively with business stakeholders, performance consultants, data scientists, and other data engineers bull Proficient in use of MS Office applications including expert level Excel programming bull Ability to quickly become an expert in operational processes and data of lines of business bull Ability to troubleshoot and document findings and recommendations bull Ability to communicate risks, problems, and updates to leadership bull Ability to keep up with a rapidly evolving technology space EEO Employer Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at orPrincipal Data Engineer 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.