Data Engineer

Crox Consulting Inc
Crox Consulting Inc

  • US
  • Post Date: 21 August 2020
  • Views 11
Job Overview

Position Data Engineer Duration 6-12 Months Contract to Hire Location Wilmington, DE Richmond, VA (Remote until this year, later onsite) Interview Phone F2FVideo Responsibilities Develop sustainable data driven solutions with current new gen data technologies to meet the needs of our organization and business customers Help develop solutions for streaming, real-time, and search-driven analytics Must have a firm understanding of delivering large-scale data sets solutions and SDLC best practices Transform complex analytical models in scalable, production-ready solutions Utilizing programming languages like Java, Scala, Python Manage the development pipeline of distributed computing Big Data applications using Open Source frameworks like Apache Spark, Scala and Kafka on AWS and Cloud based data warehousing services such as Snowflake. Leveraging DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test Driven Development to enable the rapid delivery of working code utilizing tools like Jenkins, Maven, Nexus, Terraform, Git and Docker Must have Spark ETL experience Hands-on and put things into production. Done design support. Built and designed data marts and familiar with data modeling. Solid experience working in AWS environment At least 8 years of experience with the Software Development Life Cycle (SDLC) At least 5 years of experience working on a big data platform At least 3 years of experience working with unstructured datasets At least 3 years of experience developing Microservices Python, Java, or Scala At least 1 year of experience building data pipelines, CICD pipelines, and fit for purpose data stores At least 1 year of experience in cloud technologies AWS, Docker, Ansible, or Terraform At least 1 year of Agile experience At least 1 year of experience with a streaming data platform including Apache Kafka and Spark Preferred Qualifications 5 years of data modeling and data engineering skills 3 years of Microservices architecture RESTful web service frameworks 3 years of experience with JSON, Parquet, or Avro formats 2 years of creating data quality dashboards establishing data standards 2 yearsrsquo experience in RDS, NOSQL or Graph Databases 2 years of experience working with AWS platforms, services, and component technologies, including S3, RDS and Amazon EMR

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.