Data Engineer

Job Overview

Datanomics, a full service provider of computer consulting services since 1982, is currently seeking for our client a Data Engineer who organizesstructures code into reusable libraries (i.e., thinks and acts like a software developerengineer). Ideal candidates ensure the development environment is modular, extensible, well documented, and easily usable by other organizations. To be successful, you will have extensive experience building analytic solutions in a cloud-native manner on AWS. You will approach large and complex problems with a platform mindset and possess the ability to identify patterns and collaborate with the platform team to build extensible solutions that adhere to cloud-based architectural principles and best practices (e.g., flexibility and adaptability to change, security, reliability, cost optimization). The position is WFH (Eastern Time zone). This is a long-term consulting assignment-initial contract running through year end, with extensions expected. Compensation is DOE. Critical skillsexperiences Adherence to modular software development principles, code management, etc. Mastery of Spark, PySpark, Python and ETL. Extensive hands-on experience implementing data migration and data processing using AWS services such as Athena, Glue, Lambda, S3, DynamoDB NoSQL, Relational Database Service (RDS), Amazon EMR and Amazon Redshift. Heavy ETL, Python, and AWS required. 3+ years of hands-on experience in implementation and performance tuning HadoopSpark implementations. 3+ years of experience of Data LakeHadoop platform implementation, utilizing AWS. Datanomics is an equal opportunity employer.