Senior Data Engineer

Cubic Technologies
Cubic Technologies

Job Overview

Role Sr. Data EngineerLocation Denver, CO Job Description middot Deploy Enterprise data-oriented solutions leveraging Data Warehouse, Big Data and Machine Learning frameworks middot Optimizing data engineering and machine learning pipelines middot Support data and cloud transformation initiatives middot Contribute to our cloud strategy based on prior experience middot Understand the latest technologies in a rapidly innovative marketplace middot Independently work with all stakeholders across the organization to deliver point and strategic solutions Skills – Experience and Requirements middot Should have prior experience in working as Data warehouseBig-data. middot Experience in advanced Apache Spark processing framework, spark programming using Scala or Python with knowledge in shell scripting. middot Coding experience in Java andor Scala is a must. middot Experience in using AWS APIs ( e.g., JavaAPI, Boto3, etc.) to integrate different services middot Should have experience in both functional programming and Spark SQL programming dealing with processing terabytes of data middot Specifically, this experience must be in writing Big-data data engineering jobs for large scale data integration in AWS. Prior experience in writing Machine Learning data pipeline using Spark programming language is an added advantage. middot Advanced SQL experience including SQL performance tuning is a must. middot Experience in logical physical table design in Big data environment to suit processing frameworks middot Knowledge of using, setting up and tuning Spark on EMR using resource management framework such as Yarn or standalone spark. middot Experience in writing spark streaming jobs (producersconsumers) using Apache Kafka or AWS Kinesis is required middot Should have knowledge in variety of data platforms such as Redshift, S3, DynamoDB, MySQLPostgreSQL middot Experience in AWS services such as EMR, Glue, Athena, IAM, Lambda, Cloud watch and Data pipeline middot Experience in AWS cloud transformation projects are required.Senior Data Engineer 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.