Data Engineer

Job Overview

As a data engineer, you will build a solid data foundation that powers the entire spectrum from Business Intelligence to Artificial Intelligence. Yoursquoll be critical to helping us in our transition from batch to real-time, one-to-one to many-to-many connections, centrally managed infrastructure to self-service tools that allow easy experimentation, and from manual to automated processes. This role will work closely with the Data Science and AI team and will focus on the enablement and acceleration of new and existing workflows. We need someone who will bring a thoughtful perspective, empathy, creativity, and a positive attitude to solve problems at scale. This role is ideal for someone looking to extend software engineering skills into the field of Machine Learning and Artificial Intelligence. Responsibilities bull Establish scalable, efficient, automated processes for data analyses, model development, validation and implementation bull Work closely with data scientists and analysts to create and deploy new features bull Write efficient and well-organized software to ship products in an iterative, continual-release environment bull Monitor and plan out core infrastructure enhancements bull Contribute to and promote good software engineering practices across the team bull Mentor and educate team members to adopt best practices in writing and maintaining production code bull Communicate clearly and effectively to technical and non-technical audiences bull Actively contribute to and re-use community best practices Requirements bull University or advanced degree in engineering, computer science, mathematics, or a related field bull Strong experience working with a variety of relational SQL and NoSQL databases bull Strong experience working with big data tools Hadoop, Spark, Kafka, etc. bull Experience with at least one cloud provider solution (AWS, GCP, Azure) bull Strong experience with object-orientedobject function scripting languages Python, Java, C++, Scala, etc. bull Ability to work in Linux environment bull Experience working with APIs bull Strong knowledge of data pipeline and workflow management tools bull Expertise in standard software engineering methodology, e.g. unit testing, code reviews, design documentation bull Experience creating ETL processes that prepare data for consumption appropriately bull Experience in setting up, maintaining and optimizing databases for production usage in reporting, analysis and ML applications bull Working in a collaborative environment and interacting effectively with technical and non-technical team members equally well bull Relevant working experience with Docker and Kubernetes preferred bull Ability to work with ML frameworks preferred Will be a plus Knowledge of CICI processes and components Experience with OKTA and Optimizely NB Placement and Staffing Agencies need not apply. We do not work with C2C at this time. At this moment, we are not able to process H1B transfers.