Azure Data Engineer

Job Overview

Azure Data Engineer Duration 1 year with high chances of extension Location Chicago, IL. For now, remote until COVID-19 Responsibilities Senior Cloud Data Engineer to be part of the team enabling the journey from On-Premise to Microsoft Azure in the areas of architecture, development security, operations, integration, migration, and managed services. As a Senior Cloud Engineer, you will participate and lead technical teams to architect, build, and deploy cloud solutions for highly complex distributed software systems in Microsoft Azure. Training team members on the technologies and share knowledge on best practices. Documenting the design and processes after development. Qualifications and Skills required 10+ years of experience with data platforms, data warehouses, ETL. Hands-on experience at least 4 yrs and expertise with ADF, Spark, Databricks, Python, and ADLS. Hands-on experience on performance tuning and optimization code running in data bricks environment. Hands-on experience implementing Delta lake concepts delta table, SCD, schema evolution..etc. Working experience with Visual Studio, PowerShell Scripting, and ARM templates. Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows. Strong knowledge of Common Data Model (CDM), Common Data Services (CDS), and Power BI Data Flows. Experience in using Azure key vault, logic apps, Azure DevOps, Run books, Azure Data Catalog, Informatica EDC is preferred. Experience with Data API Gateways to extract data from 3rd party apps. Strong understanding of Cloud concepts ndash IaaS, PaaS, SaaS