Senior Distributed Software Engineer – Big Data Warehouse


Job Overview

Netflix is changing the way the world is entertained, and the data platform team is a critical part of that transformation. The Big Data Warehouse team is creating the bedrock upon which Netflix’s data strategy will be built.Our group is a dynamic one, and we are continually evaluating potential long-term, high-impact projects that affect hundreds of engineers and hundreds of petabytes of data. Successful candidates will be comfortable both owning some projects and advising on others.

Challenges we’ll be tackling over the next few years include:

  • Increasing the efficiency of the warehouse by helping users keep the highest value data by improving our distributed garbage collection system that already deletes 2.7 petabytes and 70 million files per day.
  • Using machine learning to tune the storage of our data to balance fast access vs. storage and ingest cost.
  • Building a system to catalog all of Netflix’s data, both the data at rest and the dynamic graph connecting how data moves through our many ingestion and processing systems.
  • You’re a good fit for this role if your strengths include:

  • The courage and professional maturity to have principled, evidence-based discussion of multiple approaches to a single challenge.
  • Working with eventually consistent cloud services and building highly available applications on top of them.
  • A product mindset, in which engineering costs are measured against the benefits to our partners.
  • Navigating ambiguity and finding clarity on multi-team, multi-year initiatives.
  • Balancing the benefits of building new platforms vs. adding challenging and complex features to older platforms.
  • Qualifications:

  • At least five years of experience in building high-throughput, high-availability distributed applications.
  • A BS, MS, or PhD in computing.
  • View More
    Job Detail
    Shortlist Never pay anyone for job application test or interview.