Job Overview
Job Title Senior Data Engineer Location San Mateo , CA Duration 6+ months Rate DOE No. of Positions 2 Description Position Summary Very Strong engineering skills. Should have an analytical approach and have good programming skills. Provide business insights, while leveraging internal tools and systems, databases and industry data Minimum of 5+ years’ experience. Experience in retail business will be a plus. Excellent written and verbal communication skills for varied audiences on engineering subject matter Ability to document requirements, data lineage, subject matter in both business and technical terminology. Guide and learn from other team members. Demonstrated ability to transform business requirements to code, specific analytical reports and tools This role will involve coding, analytical modeling, root cause analysis, investigation, debugging, testing and collaboration with the business partners, product managers other engineering team. Must Haves Excellent knowledge and experience with Hive and SQL Experience with Spark SQL Proficient with one programming language JavaScalaPython General understanding of how to build end-to-end data pipelines Good to Have Experience n architecting data pipelines from Data model to the jobs and the sequence of jobs Ability to build dashboards with Tableau or looker Software Engineering knowledge ability to build web applications using Java and AngularJS or ReactJS tech stacks Technical Requirements Knowledgeexperience on Teradata Physical Design and Implementation, Teradata SQL Performance Optimization Advanced SQL (preferably Teradata) Experience working with large data sets, experience working with distributed computing (MapReduce, Hadoop, Hive, Pig, Apache Spark, etc.). Strong Hadoop scripting skills to process petabytes of data Experience in UnixLinux shell scripting or similar programmingscripting knowledge Experience in ETL processes Real time data ingestion (Kafka) Education BS degree in specific technical fields like computer science, math, statistics preferred
Job Detail
More jobs from our partners (1166)
AmazonData Engineer II Direct Fulfillment on15 January 2021Any
AmazonData Engineer II on15 January 2021Any
AmazonData Engineer, Prime Video on15 January 2021Any
MapboxSenior Data Engineer, Geodata on14 January 2021Any
AppleApple Media Products – Senior Data Engineer on9 January 2021Any
AppleAI/ML – Voice Building Engineer, Siri Text-to-Speech on14 January 2021Any
AppleManager – Big Data Engineering – Wallet & Apple Pay – NYC on14 January 2021Any
AppleBig Data Engineering Lead – Wallet & Apple Pay – NYC on12 January 2021Any
AppleApple Media Products Engineering – Senior Developer, Big Data on15 January 2021Any
AppleAI/ML – iOS Engineer Voice Input/Dictation, Siri Experience on12 January 2021Any