Senior Data Engineer

360pi
360pi

Job Overview

Numerator is looking for a Senior Data Engineer who is a Big Data enthusiast and has a passion for working with an interesting robust set of data. This person will work in our platform to help ensure that our data quality is flawless. As a company, we have millions of new data points every day that come into our system. You will be working with a passionate team of engineers to solve challenging problems and ensure that we can deliver the best data to our customers, on-time. You will be using the latest cloud data warehouse technologies to build robust and reliable data pipelines.Duties/Responsibilities Include* Develop expertise in the different upstream data stores and systems across Numerator* Design, develop and maintain data integration pipelines for Numerators growing data sets and product offerings* Collaborate with product and engineering teams to take requirements from prototype to production* Build data validation testing frameworks to ensure high data quality and integrity* Write and maintain documentation on data pipelines and schemasRequirements* Bachelors degree in Computer Science or related field of study required; Masters degree preferred* 5 + years of experience in the data warehouse space* Knowledge of software engineering best practices across the development lifecycle, coding standards, code reviews, source management, build processes, testing, and operations* Knowledge of and experience implementing data security and governance best practices* Expert in SQL, including advanced analytical queries, window functions, CTEs and query optimization* Advanced proficiency in Python (data structures, algorithms, object oriented programming, using APIs)Experience administering a cloud data warehouse (Redshift, Snowflake, Vertica)* Experience with a data pipeline scheduling framework (Airflow)* Experience with schema design and dimensional data modelingExceptional candidates will have* Amazon Web Services (EC2, DMS, RDS) experience* Terraform and/or ansible (or similar) for infrastructure deployment* Airflow — Experience building and monitoring DAGs, developing custom operators and using script templating solutions* Experience supporting production systems and developing on-call/incident management playbooks* Ability to work with team members located in multiple geographies and time zones.* Curious and interested in learning about the latest in data warehouse technology Interest and willingness to mentor junior team membersWhat we offer you* An inclusive and collaborative company culture – we work in an open environment while working together to get things done, and adapt to the changing needs as they come.* An opportunity to have an impact in a technologically data driven company.* Ownership over platforms and environments of an industry leading product.* Market competitive total compensation package.* Volunteer time off and charitable donation matching.* Strong support for career growth, including mentorship programs, leadership training, access to conferences and employee resource groups.* Regular hackathons to build your own projects and Engineering Lunch and Learns.* Great benefits package including health/vision/dental, unlimited PTO, 401k matching, travel reimbursement and more.If this sounds like something you would like to be part of, we’d love for you to apply! Don’t worry if you think that you don’t meet all the qualifications here. The tools, technology, and methodologies we use are constantly changing and we value talent and interest over specific experience.We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law.

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.