Data Engineer

Infinity Consulting Solutions
Infinity Consulting Solutions

Job Overview

Job Description – Data Engineer Recognized American Diversified Multinational Mass Media and Entertainment Conglomerate is seeking an experienced Data Engineer that knows SQL. The role includes database and data warehouse design, querying, programming, modeling, management, and day-to-day operations. A data engineer is expected to assist in databasewarehouse security configuration, setup and administration of various users and roles, SQL querying, Docker setup and deployment, executing automated database migration scripts, writing and running automated data testing, resolving production data issues, leveraging CICD deployment practices, integration with data pipelines, and architectural discussions regarding the overall platform. Data modeling might include financial forecasting and reporting, personnel allocation, delivery performance, operational metrics from system logs, and more. A data engineer must be well-versed in centralizing disparate data sources within the enterprise to provide highly scalable reporting to serve the business. The data engineer will be expected to coordinate with data pipeline engineers and business data consumers in an integrated and dynamic team environment. The team is currently maturing out of a POCMVP phase into a fully-fledged enterprise-grade production capacity. The data engineer will immediately be tasked with helping migrate our data and analytics processing out of our current AWS RDS MySQL data layer to the data warehousing technology Snowflake. Experience working in data warehouses ” Bachelor’s in computer science ” Experience working in automated deployment pipeline ” Experience with relational databases like my sql ” Experience with snowflake is ideal! (oracle, redshift is good too) 5+ years of experience in developing medium-to-large scale enterprise applications as a Data Engineer ” SQL – 5+ years of full-time experience working with SQL Server – Database management or DBA experience – Experience with MySQL – Experience with Snowflake – Experience with processing JSON and delimiter-separate files (CSV, TSV, etc) – Experience with automated migration tools such as Flyway or Liquibase – Ability to write complex queries, stored procedures, create views, learn from documentation as needed – Understanding of efficient data warehouse storage and performance practices – Understanding the differences between typical OLTP and OLAP architectures – Understanding of enterprise Security and Data Governance principles AWS – Understanding of AWS RDS and S3 – Experience with AWS cloud architecture, security, networking a big plus ” Java – 3+ years of full-time of writing Java – Experience using JUnit testing framework ” Docker – 1+ years’ experience with Docker ” General Programming – Advanced programming and data querying skills – 5+ years of full-time programming experience – Experience with Test-Driven Development (TDD) a big plusData Engineer 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.