Lead Data Engineer with Python & Scala exp_VA_SK

Pyramid Consulting, Inc.
Pyramid Consulting, Inc.

Job Overview

Direct Client Requirement Immediate need for a Lead Data Engineer with Python Scala exp Richmond, VA JobDiva 20-22294 Position Lead Data Engineer with Python Scala exp Location Richmond, VA Position type 6+ months Contract JOB DESCRIPTION As a Data Engineer, you’ll be part of an Agile team dedicated to breaking the norm and pushing the limits of continuous improvement and innovation. You will participate in detailed technical design, development and implementation of applications using existing and emerging technology platforms. Working within an Agile environment, you will provide input into architectural design decisions, develop code to meet story acceptance criteria, and ensure that the applications we build are always available to our customers. You’ll have the opportunity to mentor other engineers and develop your technical knowledge and skills to keep your mind and our business on the cutting edge of technology. At, we have seas of big data and rivers of fast data. THE JOB Collaborating as part of a cross-functional Agile team to create and enhance software that enables state of the art, next generation Big Data Fast Data applications Building efficient storage for structured and unstructured data Developing and deploying distributed computing Big Data applications using Open Source frameworks like Apache Spark, Apex, Flink, Nifi, Storm and Kafka on AWS Cloud Utilizing programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift Utilizing Hadoop modules such as YARN MapReduce, and related Apache projects such as Hive, HBase, Pig, and Cassandra Leveraging DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test Driven Development to enable the rapid delivery of working code utilizing tools like Jenkins, Maven, Nexus, Chef, Terraform, Ruby, Git and Docker Performing unit tests and conducting reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance BASIC QUALIFICATIONS At least 3 years of professional work experience in data warehousing analytics At least 3 years of experience in open source programming languages for large scale data analysis At least 2 years of Java development for modern data engineering At least 2 years of data modeling development At least 1 year of experience working with cloud data capabilities PREFERRED QUALIFICATIONS 3+ years of experience in Python, Scala, or R for large scale data analysis 3+ years’ experience with Relational Database Systems and SQL (PostgreSQL or Redshift) 3+ years of UNIXLinux experience 2+ years of Agile engineering experience 2+ years of experience with the Hadoop Stack 2+ years of experience with Cloud computing (AWS) 1+ years of experience with supervised machine learning Our client is a leading Banking Financial Domain and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.Lead Data Engineer with Python & Scala exp_VA_SK 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.