Data Engineer

Job Overview

Description Remote work to start – will need an onsite worker once facility reopens. POSITION SUMMARY ndash Requirements and Design Reason for contingent headcount? DnA project support What is the project(s) name? Enterprise Data Modernization initiative to modernize the data supply chain for TFS portfolio to support all stakeholders for their data consumption needs. What are the key objectives for this resource (project summary)? In depth knowledge about data warehousing (data acquisition, data management and data consumption) and Cloud data Platform ETL Design on assigned projects. Translate business requirements into technology solutions Integrate the data pipelines with various upstream and downstream applications Examine and identify database structural necessities by evaluating client operations, applications, and programming. Build and Design end to end data pipeline using Amazon AWS, Spark and Snowflake data warehouse Development Expertise with Spark Using Python Aid in gathering Requirements, conducting Business Analysis, and writing technical design specifications. Understanding of Conceptual Logical and Physical Data Models define logical views and physical data security structures. ETL performance tunings using optimization, code quality and standards. Define Different Data Framework and Standards around those. Perform problem determination (root cause analysis), document the source of problems and their resolution. Recognize and analyze trends in errors so as to identify and install long term solutions to problems. Adhere to Development Standards, Best Practices and Guidelines to ensure compatibility, scalability, and integration with other data platforms. Best Practices in leading a development team providing guidance training and taking care of the work reviews. Recognize and adopt best practices in reporting and analysis data integrity, test design, analysis, validation, and documentation. Effectively communicate with Business users and customers. Review the designs and code created by others and provides constructive feedback. Work with product owners to identify areas requiring decisionsclarity in order to define project scope and objectivesrequirements. Identify and assess risks due to changes in scope (business decisionschanges), resources, or timeline Align architecture diagrams and process flows to project plan to identify and remediate gaps Keep open communication with all team members involved What specific TFS departments will they interact with? DnA (Data And Analytics) Risk Management IDS SOX PMO How long is this project (please be specific)? Through March 2022 What phase is the project currently in? Requirements List the position Requirements Ability to work at both detail and high level Ability to communicate to multiple audiences Work across multiple departments to ensure that all components supporting the end-to-end objectiverequirement have been assigned Technical lead experience with large technology implementations Must Haves Data Engineering technical acumen Extensive experience building Cloud technology using Spark Strong Communication skills and able to work with many types of people Ability to drive across multiple stakeholder organizations Preferred Nice-to-haves Business Intelligence experience Cloud technology experience with AWS, Spark Snowflake 8-12 years of relevant work experience (in similar field andor industry) Thanks , Jani ,