Data Engineer


Job Overview

Under minimal supervision, designs, develops, and deploys enterprise-scale data systems and Business Intelligence solutions for performance reporting and analytics. Implements end-to-end, source-target-user ETLELT data pipelines over complex on-prem and off-prem platforms. Automates the collection of data from multiple source systems containing structured, semi-structured, and unstructured data integrates, transforms, organizes, and delivers data to data analysts, data scientists, and other data consumers within the agency departments. Possesses excellent programming, debugging, testing, and problem-solving skills. Leverages pragmatic data management practices and principles to ensure coherent movement of data and the delivery of information to end users. ESSENTIAL FUNCTIONS The following duties are a representative summary of the primary duties and responsibilities. Incumbent(s) may not be required to perform all duties listed and may be required to perform additional, position-specific duties. bull Analyzes business requirements, architects, and implements enterprise-class data solutions for new data projects. bull Owns the design, development, and ongoing maintenance of data warehouses, data marts, multi-dimensional cubes, and data lakes. bull Writes complex SQL queries, stored procedures, ETL workflows, views, temporary tables, and other database objects. bull Utilizes latest data technologies and cloud platforms collects, integrates, ingests, transforms, and organizes data and information to support data analyses, reporting, dashboarding, and modern analytics across the agency. bull Evaluates existing legacy data solutions redesigns and implements modern data infrastructure for robustness and greater scalability. bull Assists customers with their data related technical issues and data infrastructure needs. bull Builds analytics tools that ingest data from large disparate datasets to draw actionable insights into operational efficiencies and key business performance metrics. bull Develops automated test scripts to monitor and report on data quality issues conducts root cause analyses in response to data issues and implements cost effective resolutions for data anomalies. bull Conducts research and makes recommendations on emerging technologies, toolsets, applications, and systems. bull Collaborates with the IT Enterprise Architecture team to define data architecture framework and implement data solutions and toolsets. bull Provides input into data governance initiatives and influences the development of sustainable data management and governance practices across the agency. bull Creates and maintains architecture diagrams, system documentation, data models, mapping documents, business rules, data flow diagrams, and other design related artifacts. bull Actively participates in architecture design, and code review sessions with peers, solution architects, consultants, and vendors. bull Attends professional group meetings stay abreast of new trends and innovations in the field of information technology. bull Conducts research and makes recommendations on emerging technologies, toolsets, applications, and systems, considering among other factors cost savings, adoption, standardizationsimplification, flexibility, and reuse. bull Troubleshoots and resolves production issues quickly to ensure system uptime meets service level agreements. bull Follows agencyrsquos data classification policies and procedures, and maintain compliance with established security standards and best practices. bull Communicates statuses of all assigned tasks clearly and concisely to the project team, stakeholders, and management. bull Works cooperatively with coworkers, customers, project managers, and vendors. bull It is the responsibility of all employees to follow the Agency safety rules, regulations, and procedures pertaining to their assigned duties and responsibilities, which could include systems, operations, andor other employees. bull It is the responsibility of all employees to integrate sustainability into everyday business practices. bull Other duties as assigned. MINIMUM QUALIFICATIONS Education and Experience Bachelorrsquos Degree in computer science, information technology, engineering, or closely related field and three years of experience in information technology in the areas of data engineering, business intelligence and analytics OR an equivalent combination of education and experience. Required Licenses or Certifications None. Required Knowledge Of bull Basic principles of computer science, database technologies, and information systems. bull Advanced principles, best practices, methods, and techniques used in data engineering, business intelligence, data management, data warehousing concepts, data mapping, data modeling, reporting, analytics, and data science. bull Relational database management systems, NoSQL databases and Big Data ecosystem. bull Data pipelines, stream processing, Supervisory Control And Data Acquisition (SCADA) and Internet of Things (IoT). bull Enterprise data catalog, meta-data and master-data concepts and management. bull Full-stack DevOps engineering with understanding of compute, network, storage with cost optimized implementations. bull DevOps tools like ADO, Git, Jenkins, Dockers etc. bull Enterprise application systems related to Finance, Human Resources, Asset Management, Transit Rider Technologies, and other subject areas as needed. bull Evaluating business requirements and developing information technology solutions. bull Operational characteristics of a variety of computer and network systems, applications, hardware, software, and peripheral equipment, including enterprise business systems. bull Various methods of service delivery including agile and waterfall. bull Software development life cycle, source code version control systems, release management, change management, and ITIL processes (Incident and Change Management). bull Principles, practices, methods, and techniques used in the installation, troubleshooting, and maintenance of software systems and applications. bull Quality Assurance techniques and automated testing practices. bull Principles and practices of project management. bull Pertinent federal, state, and local laws, codes, and regulations. Required Skill In bull Architecting and implementing Business IntelligenceAnalytics platforms using tools in Microsoft Azure analytics stack such as Azure Data Factory, Azure Data Lake, Azure Synapse. bull Relational Database Management Systems (RDBMS), Microsoft SQL Server, SQL Server Integration Services (SSIS), SQL Server Analysis Services (SSAS), and other relevant technologies. bull Experience with Azure analytics stack such as Azure Data Factory, Azure Data Lake, Azure Synapse. bull Logical and physical data modeling for both OLTP and OLAP. bull Programming using C, Java, Scala, and Python scripting using PowerShell. bull Reporting technologies including, but are not limited to Microsoft SQL Server Reporting Services (SSRS), Power BI, Crystal Reports, Business Objects Enterprise, etc. bull Working knowledge and advanced skills in Excel as a data source and reporting tool. bull Big Data tools like Hadoop, Spark, MapReduce, HBase, Cassandra, Kafka, Hive, Pig, Oozie, etc. bull Creating and consuming various data formats such as CSV, XML, JSON, etc. including using of APIs or web services for data acquisition. bull Learning new applications, programming languages, development tools, and technologies quickly. bull Establishing and maintaining effective working relationships with other department staff, management, vendors, outside agencies, community groups, external business partners, and the public. bull Effective oral and written communication and the ability to convey technical details to non-technical stakeholders, senior leadership, and executives. bull Working effectively under pressure, meeting tight deadlines, and adjusting to changing priorities. Physical Demands Work Environment bull Work is performed in a standard office environment. bull Subject to standing, walking, bending, reaching, stooping, and lifting of objects up to 40 pounds may occasionally be exposed to dangerous machinery, extreme temperatures, and extreme noise when working in the data center environment or when working in the field. bull The Agency promotes a safe and healthy work environment and provides appropriate safety and equipment training for all personnel as required. Sound Transit is an equal employment opportunity employer. No person is unlawfully excluded from employment action based on race, color, religion, national origin, sex (including gender identity, sexual orientation and pregnancy), age, genetic information, disability, veteran status or other protected class. Equal Opportunity EmployerProtected VeteransIndividuals with Disabilities The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractorrsquos legal duty to furnish information. 41 CFR 60-1.35(c)Data Engineer 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.