Senior Data Engineer

Job Overview

Position Qualifications bull 6+ years of success in consultativecomplex deployment project, design, implementation andor support of data and analytics solutions bull Hands on development Design and Develop applications using Azure ADF Databricks bull In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib. bull Expertise in using Spark SQL with various data sources like JSON, Parquet and Key Value Pair. bull Experience in creating tables, partitioning, bucketing, loading and aggregating data using Spark SQLScala bull In depth understanding of Azure cloud and Data lake and Analytics solutions on Azure bull Able to build ingestion to ADLS and enable BI layer for Analytics bull Strong understanding of Data Modeling and defining conceptual logical and physical data models bull Proven track record of building deep salestechnical relationships with CXO’s and practice building executives within highly strategic system integrators bull Experience in managing various client relationships to get consensus on solutions. Position Responsibilities bull Design and Develop data Ingestion using ADF and processing layer using Databricks bull Design solutions on Microsoft Azure and related technologies including ADF, ADLS,ASA, AAS,AML and Power BI bull Work with the SMEs to implement and build data flows bull Manage data related requests, analyze issues and provide efficient resolution. Design all program specifications and perform required tests. bull Prepare code for all modules according to required specification. bull Monitor all production issues and inquiries and provide efficient resolution. bull Evaluate all functional requirements, map documents, and troubleshoot all development processes. bull Document all technical specifications and associates’ project deliverables. bull Design all test cases to provide support to all systems and perform unit tests.