Data Engineer


Job Overview

Description Skill Set Big data, ETL, Apache Spark, Linux, Python, AWS The Job – Collaborating as part of a cross-functional Agile team to create and enhance software that enables state of the art, next generation Big Data applications – Building efficient storage for structured and unstructured data – Developing and deploying distributed computing Big Data applications using Open Source frameworks like Apache Spar on AWS Cloud – Utilizing programming languages like Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services – Leveraging DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test Driven Development to enable the rapid delivery of working code utilizing tools like Jenkins, Ruby, Git and Docker – Performing unit tests and conducting reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance Basic Qualifications – Bachelor’s Degree or military experience – At least 4 years of professional work experience in Big Data development Data warehousing – At least 4 years of ETL design, development and implementation experience Preferred Qualifications 4+ years of experience with the Apache Spark 4+ years Python or Java development experience 4+ years of Agile engineering experience 3+ years of experience with Cloud computing (AWS) 5+ years of ETL experience 5+ years of scripting experience 5+ years’ of experience with Relational Database Systems and SQL 5+ years of UNIXLinux experience Team Info Managing data load into enterprise data lake 3rd party vendors send data to client then this is loaded into enterprise data environment Role Info Being able to partner with product owners Top Skills Data Engineering (Ideal candidate – 4 years of experience in Python, Spark and AWS looking for someone who is independent and can lead the project, not looking for too junior folks) Spark Scala Coding with either Python or Java AWS EMR and Lambda used by the team primarily DevOps using Jenkins, Docker, Cucumber Linux scripting experience Relational databases or data warehousing environment experience Has been through multiple development cycles If they have a strong in Java development background using Python is also okay, should have experience with Spark or Scala Many of the developers in the team are ETL developers who have Spark and Python experience, those profiles will also work ICONMArsquos Discrimination Disclaimer As an equal opportunity employer, ICONMA prides itself on creating an employment environment that supports and encourages the abilities of all persons regardless of race, color, gender, age, sexual orientation, citizenship, or disability.Data Engineer 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.