Senior Big Data Engineer


Job Overview

Senior Big Data Engineer**job details:**+ location:McLean, VA+ salary:$68.99 – $70 per hour+ date posted:Tuesday, August 18, 2020+ job type:Contract+ industry:Finance and Insurance+ reference:794793**job description**Senior Big Data Engineerjob summary:Our Major Financial client is currently seeking a Senior BigData Developer to implement BigData tools and methods of data processing and ingestion as a member of the Credit Analytics and Reporting team.location: Mc Lean, Virginiajob type: Contractsalary: $68.99 – 70.00 per hourwork hours: 8am to 6pmeducation: Bachelorsresponsibilities:o Cleanse, manipulate and analyze large datasets (Structured and Unstructured data – XMLs, JSONs, PDFs) using Hadoop platform.o Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data.o Manage and implement data processes (Data Quality reports)o Develop data profiling, deduping logic, matching logic for analysiso Programming Languages experience in Python, PySpark and Spark for data ingestiono Programming experience in BigData platform using Hadoop platform- Present ideas and recommendations on Hadoop and other technologies best use to managementqualifications:- 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs)- 3+ years of programming experience in Python, Spark for data processing and analysis.- Strong SQL experience is a must- 3+ years of experience – using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work- Must be able to manage multiple priorities and meet deadlines- Degree in Statistics, Economics, Business, Mathematics, Computer Science or related fieldskills: – Detail oriented. Excellent communication skills (verbal and written)Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.