Data Engineer – Enterprise Analytics

Job Overview

DATA ENGINEER ndash DIRECT, Full-time placement Our client will sponsor an H1B Visa Telecommute allowed from Florida, Pennsylvania, New Jersey, Connecticut or North Carolina LOCATION New York, NY If interested in discussing, please call Rita or email rdelosacontech-it.com mailtordelosacontech-it.com Our client is searching for a Data Engineer to join their team. MUST HAVE STRONG SQL AND PYTHON SKILLS Candidates must ALSO have the following Comprehensive experience and understanding of AWS (or other cloud computing ecosystem) Demonstrates holistic knowledge of architectural design and principles Background in Database Administration and Management. Must have an understanding that the team is responsible for maintaining and improving data with many downstream dependencies to deliver analytic insights. The candidate doesnrsquot need to have a lot of cloud experience but need to have considerable data pipelines and orchestration experience The manager needs someone who is seasoned and has experience and should be able to start without any training If a candidate has done data pipelines using other tools, and are really strong, the manager will consider that experience as well Passion for software engineering, continuous improvement, and learning. Experience working closely with teams to build and support continuous integration, deployment, and orchestration Develop automation code to support DevOps applications (Cloud Formation Templates) Demonstrates holistic knowledge of architectural design and principles The tools that you must have experience with are SQL PySpark Python AWS Products Data Pipeline Cloudformation Lambda Redshift S3 – Cloud Storage EC2 Roles Responsibilities Analyst warehouse for the data science team Take all the data sources and bring them into modern AWS architecture Improve the quality of the data the user access Ingesting new data through pipelines Improve speed of data ingestion MUST BE a true ETL engineer Must have done extensive automation on several projects to create data pipelines Our client has over 3000 tables with requirements to handle them differently No formal SDLC in place. The candidate needs to know CICD concepts Need to create and identify and move large data faster and efficiently Automation through functions (Lambda) and scripts