Data Engineer

Mastech Digital
Mastech Digital

Job Overview

Mastech Digital provides digital and mainstream technology staff as well as Digital Transformation Services for all American Corporations. We are currently seeking a Data Engineer for our client in the Consulting domain. We value our professionals, providing comprehensive benefits and the opportunity for growth. This is a Contract position and the client is looking for someone to start immediately. Duration 6+ Months Contract Location Newark, NJ Role Data Engineer Primary Skills Apache Spark Role Description The Data Engineer would need to have at least 5 years of experience. For this role, you must be a Data EngineerDeveloper to build the next generation data platform from ground up on AWS as part of a small focused team. As an ideal candidate, you must have strong knowledge of computer science fundamentals with programming experience in ScalaPython and Spark. You must be able to identify this challenge as a unique and valuable opportunity to help drive global the technology transformation. Must Have – Heavy Scala, Python and Spark. Responsibilities – Build complex data ingestion pipelines using Scala, Spark, Parquet and S3 – Design scalable processes in event driven architecture to support Fixed Income applications – Develop near real time streaming analytics using KafkaKinesis – Act as Subject Matter Expert and help rest of the team in leveraging the platform and migrating applications to it – Establish end to end data lineage and data catalogue. – Work with data governance team to setup data quality checks and metrics – Create self-service notebook environment with ZeppelinJupyter for exploratory data analytics and rapid interactive development. – Troubleshoot any performance issues and ensure efficient data organization – Build efficient web-based tools for monitoring and tracking Required Qualifications – Bachelor’s degree in computer science or related field required. Master’s degree preferred. – Knowledge of data structures, algorithms and functional programming – Passion to learn new things, experiment with new ideas and build world class data platform – 5+ years of experience in programming with Scala, Python or Java – 2+ years of experience in Scala, Spark and functional programming. – Deep knowledge of spark internals such as partitioning, DAG, lazy evaluation. – Strong experience with relational data bases, SQL, and query optimization. – Knowledge of data warehousing, dimensional data model and business intelligence is a plus. – Knowledgeexperience with event driven programming and Akka actor model – Excellent verbal and written communication skills Desired Qualifications – Experience with AWS infrastructure, docker, ECSEKS, EMR, KafkaKinesis. – Front-end development experience with Angular, Java Script, Reactive Programming. – Knowledge or desire to learn Investment Management, Fixed Income and Finance. – Familiarity with NoSQL and ElasticSearch Education Four-year college degree or relevant business experience required Bachelor s degree in Computer Science, ElectricalElectronic Engineering, Information Technology or another related field or Equivalent. Experience Minimum 5 years Relocation This position will not cover relocation expenses Travel No Local Preferred Yes Recruiter Name Shubhangi Arora Recruiter Phone(Ext 2197) Equal Employment Opportunity LI-SA2 Mastech1 Minimum Education Required Bachelor Years of Experience Required More than 5 yearsData Engineer 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.