AI/ML – Sr Data Engineer, Siri Data

Job Overview

Key Qualifications

4-5+ years of data engineering experience

3+ years of coding in Python, Java, Scala, or other mainstream programming languages

3+ years working with technical partners from multi-functional groups to collect business requirements, build consensus, and handle expectations

3+ years building and monitoring robust data pipelines in distributed computing environments

Bonus: Experience with designing schema for instrumentation and logging systems OR experience supporting and partnering with data science

Description

Partner with data scientists, analysts, software engineers, and product managers to understand and collect use cases. Curate a generalized data model based on those use cases that meets the needs of the many. Instrument the proper logging to make sure the data you need is being generated. Build a robust data pipeline to populate your model with mission-critical data. Educate your consumers on how to access your model, assuring transparency in logic definitions. Push your learnings up the stack, making sure that all upstream systems are aware of your needs and their impact.Skills we’re looking for:• Python• SQL• Data Modeling• Distributed computing experience like Spark, MapReduce, or Hive (Spark preferred) Bonus points if you have experience with:• HDFS, S3, or other cloud data storage technologies• Presto, Hive, Solr, or Druid• Data engineering in a cloud environment

Education & Experience

B.S., M.S., or Ph.D. in Computer Science, Computer Engineering, or equivalent practical experience.

View More