Big Data Developer with Airflow

Global Talent Resources
Global Talent Resources

Job Overview

Need experience with installing, configuring and monitoring Apache Airflow including Airflow cluster AWS cloud environment and as a database client is using redshift so need redshift expert Overall 7+ years of data warehousing experience Minimum 2-3 years of experience on Apache Airflow in recent project Develop guidelines for Airflow cluster and DAGs. Performance tuning of the DAGs and task implementation Develop DAG – data pipeline to on-board and change management of datasets Experience with Apache Airflow, including installing, configuring and monitoring Airflow cluster Understanding of airflow rest services and integration of airflow of platform eco-system Orchestrating the Airflow workflow in hybrid cloud environment is big plus Python amp Pandas, with demonstrated experience in ETL Ability to maintain clean and secure data environments Working in a hybrid cloud environment Must have hands on experience with advanced sql Redshift experience in the cloudBig Data Developer with Airflow 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.