Lead Data Engineer

Job Overview

Role Lead Data Engineer Duration – 9-18+ months long term Location – Providence, RI Develop the end-to-end data flow architecture of ETL process on AWS cloud, extraction, transformation and load of data functions Develop EDI Mapping via MapForce or homegrown EDI transformer, process the data extraction as per the targetdesired state of ETL process. Develop test plans for ETL unit testing and integration testing Implement Data structure, mapping, enrichment etc. Validate ETL end-to-end solution performance and troubleshoot problems Experience with ETL tools on AWS like AWS Glue Programming skills with Python, Java or Scala and implement on AWS Lambda, Glue Implement ETL jobs, auto-scaling Implement Security standards Work with ETL lead to validate the ETL implementation is as per the design. Implement data collection methods, data models, types and transformation process.