Data Engineer

SIAL TECHNOLOGY PARTNERS
SIAL TECHNOLOGY PARTNERS

Job Overview

Job Title Data Engineer Location Mclean (remote and then onsite) Duration 12 months to start, with extensions available Interview 45 minute zoom after online coding test Primary skills o 5+ yrs overall minimum o Spark, Python and Pyspark-minimum 3 yrs experience o AWS, Cloud services in (EMR, S3, develop automated scripts in EMR and deploy Spark apps on AWS, RDS, SQS, Lambda and services for deployment)-3 yrs minimum experience middot Creating CICD pipelines and deploying apps in AWS middot Nice to have any experience with Airflow for orchestration, Tableau and Kubernetes Job Description middot 5+ years of hands-on professional (not academic) experience in pioneering data engineering andor big data. middot 3 + years of experience with data integration with Apache Spark, EMR, Glue, Kafka, etc ecosystems middot 3+ years of strong hands-on experience in python development especially in Pyspark . middot 2+ years of hands-on experience with using AWS services S3, EC2, EMR, middot 2+ RDS, Glue, Lambda, EKS, ECS middot Design, develop test, deploy, maintain, and improve data integration pipeline. middot Experience in Python and common python libraries. middot Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and continuous integration tools. middot Experience with continuous deployment (CICD) Databricks, Airflow and Snowflake Experience is a plus. middot Experience with databases (PostgreSQL, Redshift, MySQL, or similar) Strong analytical and problem-solving skills Excellent oral and written communication skills Must be comfortable with an unstructured, fast moving and constantly evolving high growth environment. middot Self-motivated and able to work efficiently with both on-location and remote teams. We look forward to reviewing your profileCV. Thank you Talent Team SIAL Technology PartnersData Engineer 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.