AI/ML – Batch Processing Engineer, Siri Search & Knowledge Platform

Job Overview

Key Qualifications

– Passionate about Data Processing and Big Data Technologies

– Experience building, operating, and troubleshooting batch processing systems (Spark, Presto, Hive)

– Experience developing, debugging, and tuning batch processing applications

– Experience with alerting, monitoring and remediation automation in a large scale distributed environment

– Programming experience in Scala, Java, Python or Go

– Interest or knowledge in using public or private Kubernetes frameworks for scaling data and services infrastructure

– Experience in configuration management (Puppet, Chef, or Ansible)

BONUS:

– Committers/PMC of or experience contributing to popular open-source batch processing projects

Description

You will be responsible for designing and building the batch processing platform to empower data analytics and machine learning of worldwide Siri events. To run our environment efficiently, we drive for proper monitoring, alerting and automation. The team’s goal is to ensure the reliability and performance at the highest level.As a member of the AIML Data Infrastructure Batch Processing Team, your responsibilities include: – Manage one of Apple’s largest infrastructure supporting hundreds of millions of Siri customers – Take part in designing and building out our next generation batch data processing infrastructure and push our services to the next level – Diagnose, fix, improve, and automate complex issues across the entire stack to ensure maximum uptime, performance, and scalability – Establish SLA’s for all datasets and applications running in production – Advise other teams (within and outside of Siri) on proper integration of our platform – Build relationships with Data Engineers, Data Scientists, Product Managers and Software Engineers to understand their data needs and help them better use our platform – Manage the infrastructure which powers ETL, Analytics, and Privacy Efforts within AIML

Education & Experience

BS, MS, or PhD degree in Computer Science or equivalent and 5+ years experience in data technologies

View More