Lead Data Engineer

Job Overview

Data Engineer with 3 years of experience in implementing modern data architectures and 2 years of a Data Streaming. We have a data streaming platform to enable frictionless data flow from business systems and 3rd party sources using publishsubscribe model. Partner on the design, deployment, and persistence of our new reporting and analytics platform that unifies the data across organization, using Confluent Kafka. Develop containerized microservices (PythonFlask ) to transform and enrich topic data Lead by example best practices reusable materialization of data Partner on setting standards, implementing tools, and creating documentation for self-serve data pipeline services supporting core engineering and professional services use cases. Work with existing engineering teams to become data producers and consumers to and from Confluent Kafka Work with business intelligence engineers, analysts and Data Scientists Strong experience with event streaming such as (Kafka or Amazon Kinesis) Experience with SQL and NoSQL databases (PostgreSQL, MongoDB, etc) Desire to show ownership of problems you identify and proven ability to empower others to get more done Proficient delivering services within AWS The ability to communicate cross-functionally, derive requirements and architect shared datasets ability to synthesize, simplify and explain complex problems to different types of audiences, including executives Experience with Confluent Kafka Demonstrated ability to develop containerized microservices (Docker with Kubernetes) Experience developing serverless data pipelines