Senior Data Engineer

VF Corporation
VF Corporation

Job Overview

Job Ad

Sr. Data Engineer: Become the Newest Member of the VF Family

We are looking for a Data Engineer to lead a development team for Analytics Platform, and responsible for the quality of its technical deliverables. Need to work in strict collaboration with Product Owner and Scrum master in Agile (Scrum mainly/Kanban when necessary) help them to estimate and planning each development activity. 

Interact when is necessary with Product Owner to understand business requirements and translate in technical requirements (architecture/technical design). Working with Data Engineers to develop those requirements taking in consideration the whole SDLC (Analysis, Development, Documentation, QA, Release, Support). Assign tasks based on the engineer’s skills to maximize the efficiency of the team as well be an active part of the development process. Provide help and tools to Data Scientist team, working in coordination to have a seamless integration with Data Science Models and Pipelines. Coordinate activities related to the support, involving Data Engineers and DevOps whenever is necessary, even external team (ie: Network Security, Architects and other). 
 
Constantly meet the Data Engineer to coach and support them clarify any doubt about development/deployment activities. 

How You Will Make a Difference:

  • Evaluate and recommend key technology elements for Analytics platform
  • Responsibility for technical quality of the deliverable
  • Maximize the efficiency of the team
  • Collaborate with Solution Architects to ensure technical direction
  • Provide standardization and guidelines to the Big Data engineers, QA engineers 
  • working in the Data Engineer team.

  • Development of big data pipeline
  • Work in a team with other data engineer to release deliverable for the business
  • Participate in an Agile squad (scrum team)
  • Perform proof-of-concepts in new technologies.
  • Provide on-call production support as needed.
  • Years of Related Professional Experience: 10+

    Educational/ Position Requirements:

  • 10+ years of overall software development experience with 3+ years in AWS cloud platform
  • Previous experience as a Software Engineer/Big Data Engineer
  • Familiarity with JIRA & Confluence or similar tracking and management tools
  • Excellent organizational, verbal and written communication and the ability to present information in a clear, concise and complete manner
  • Self-starter, creative, enthusiastic, innovative and collaborative attitude
  • Ability to prioritization task based on sense of urgency and accuracy
  • Strong team player with good communication & interpersonal skills.
  • Bachelor’s Degree/Master’s degree in computer science or IT Engineering, or equivalent education and experience required.
  • Development and support of performant pipelines
  • Hands on experience on AWS serverless stack (Lambda, S3, API Gateway, SQS/SNS, Cloudwatch
  • Consolidation of different sources of data (API, SQL Database, CSV, S3 and ftp files etc) into a centralized data store.
  • Agile development of Data Lake / Data Warehouse and ETL / EMR (Glue, Hadoop, Spark, YARN, HUE, REST APIs, HIVE).
  • Redshift and BigQuery as data ware house system.
  • Experience with RDBMS (MySQL, Oracle) and SQL/DDL Language, and NoSQL (DynamoDB)
  • Development of message queue driven systems (Amazon SQS, SNS and Lambda based functions)
  • Development of streaming system (ie: Kinesis Stream, Kinesis Firehose)
  • Python development, PySpark development
  • Lambda development in Python, Node
  • Ability to perform code review and technical design review.
  • AWS Knowledge is mandatory
  • View More
    Job Detail
    Shortlist Never pay anyone for job application test or interview.