Software Development Engineer, Big Data (Streaming, Airflow, Spark)


Job Overview

About the teamAs Zillow’s Data Engineering Team builds incredible new platforms and tools that transform real estate across the country, we have interesting and exciting challenges to tackle. How should we manage consumer data flowing through the transactions on our platform to enable the most rewarding customer experience in the industry? How do we do this effectively at scale?We believe in autonomy and fast-paced product development, so self-motivation and high energy are must-haves for this role.About the roleThis is a ground floor opportunity to develop a comprehensive customer data platform from scratch for Zillow Group. In addition to solving complex problems in data and software engineering you will get end-to-end exposure with NoSQL data stores, microservices, and technologies like Spark, Kafka, Flink, Hive, MapReduce, and Presto. You’ll work alongside a strong team in a fun, highly visible and fast-paced environment.Who you are* A big data specialist and a hands-on coder with experience building and maintaining highly complex, reliable, and scalable data pipelines.* Strong background in Scala or Java and experience with streaming technologies such as Flink, Kafka, Kinesis, and Firehose* Experience with EMR, Spark, Parquet, and Airflow* Familiarity with a Cloud platform (e.g. AWS) and with Infrastructure-as-Code (e.g. Terraform)* Understanding of the concepts behind distributed databases, and both streaming and batch processing systems* Excellent interpersonal skills, ability to handle ambiguity and learn quickly* A degree in Computer Science or a related technical field; or equivalent work experience* Experience with other AWS technologies (e.g. RDS, SNS, SQS and Lambda) and Monitoring technologies (e.g. Splunk, PagerDuty, DataDog or Graphite) preferred* Exposure to data architecture & governance is helpfulGet to know usZillow Group houses the largest portfolio of real estate brands on mobile and the web. We are on a mission to rewire the real estate transaction and are building transformational tools and services that make it easier for everyone to find and get into a home they love. We are working to create an on-demand real estate transaction experience for every stage of the home lifecycle — for buyers, sellers, renters and borrowers – and we’re well on our way. No matter what job you’re in, you will play a critical role in making this vision a reality for millions of people.At Zillow Group, we’re powered by our inclusive work culture, where everyone has the support and resources to do the best work of their careers. Our efforts to streamline the real estate transaction is supported by our passion to empower people and enrich lives around everything home, a deep-rooted culture of innovation, a fundamental commitment to Equity and Belonging, and world-class benefits. But, don’t just take our word for it. Read our reviews on Glassdoor and recent recognition from multiple organizations, including: Fortune 100 Best Companies to Work For (#69), Fortune Best Workplaces for Diversity (#38), Fortune Best Workplaces for Parents (#31), Fortune Best Workplaces for Women (#20), Fatherly’s Best Workplaces for New Dads (#37), JUST Capital 100 Company (#69), Bloomberg Gender Equality Index constituent.Zillow Group is an equal opportunity employer committed to fostering an inclusive, innovative environment with the best employees. Therefore, we provide employment opportunities without regard to age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. If there are preparations we can make to help ensure you have a comfortable and positive interview experience, please let us know.See what information we collect about you.

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.