Azure Senior Data Engineer

Global Systems, LLC
Global Systems, LLC

Job Overview

Azure Senior Data Engineer Houston, TX 12+ months Remote till Covid-19 situation gets better Looking for an Azure Senior Data Engineer with experience in designing data centric applications in Azure leveraging the following Platform SQL Databases, ETL and ETL tools, Microsoft Azure Azure SQL Database. Data Factory, SQL Data Warehouse, App Services (Web, API, Logic apps), Azure functions, Log Analytics, networking security, Azure storage, Service Bus, Express Route VPN, Azure ARM templates Technologies SQL, Polybase, Python, Pyspark, Spark internals, Powershell, Bash,, C, javascript, entity framework, Restful services, Microservices, Visual Studio Qualifications 12+ years of professional solution delivery experience and a Bachelor of Computer Science, MIS or equivalent degree. 10+ years of experience as a ETL Developer in 1 or more Informatica, SSIS, Ab Initio, SAP Data Services. Around 3 years designing and building modern data pipelines and data streams in the AzureDatabricks environment and deployed the solution in Production. Around 3 years designing Azure data storage solutions (SQL Database, SQL Data Warehouse, Data Lake Storage) Around 3 years developing data ingestion, data processing and data optimization (Databricks, Data Factory, Informatica, PolyBase). Experience in delivering solutions within a Massively Parallel Processing (MPP) environment Experience in curation process and leveraged Data Flows, Data Bricks, Delta lake for Slowly Changed dimensions Experience in handling various file formats viz, Avro, Parquet, Delta Azure Certification a plus Experience in designing and developing User interfaces using .Net technologies Understanding of Master Data Management (MDM) and data quality tools and processes. Understanding of Lambda and Kappa architecture patterns Understanding of Devops including CICD Experience developing software architectures and key software components High level understanding of common authentication patterns and flow including single sign-on and OAuth Experience with AgileScrum methodology Ability to apply technology and consulting to solve a client business problem Sufficient depth and breadth of technical knowledge to be individually responsible for the design and scope of deliverables of a data warehouse solution. Able to communicate and present complex issues with preciseness, assurance and confidence A disciplined approach to software development and problem solving Passion of technology and a high technical aptitude Insightful and always looking for breakthrough ideas. Self-sufficient, high integrity, more than just competent Responsibilities Collaborate with data engineers, data architect, business analysts to build a modern data warehouse application on Azure Perform POCrsquos on various concepts using Azure services as required Ingest, curate data using Data Factory and Data Bricks Design, develop dimensional model in MPP environment using Azure Synapse Analytics Understanding the data architecture design, solution structures and component designAzure Senior Data Engineer 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.