Data Engineer

Job Overview

Hello, Job Title Data Engineer Location Carlsbad, CA Duration 06 Months with Possible Extension Job Details 7 to 9 years working experience in data integration and pipeline development with data warehousing . Experience with AWS Cloud on data integration with Apache Spark, EMR, Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS, MongoDBDynamoDB ecosystems Strong real-life experience in python development especially in pySpark in AWS Cloud environment. Design, develop test, deploy, maintain and improve data integration pipeline. Experience in Python and common python libraries. Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc. Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and continuous integration tools. Experience with continuous deployment(CICD) Databricks, Airflow and Apache Spark Experience is a plus. Experience with databases (PostgreSQL, Redshift, MySQL, or similar) Exposure to ETL tools including Informatica and any other . BSMS degree in CS, CE or EE.