Job Overview
Position Big Data Developer Location NYNJ and Atlanta, GA Interview Type Phone Skype Visa Type , GC, GC-EAD and NO H1B OPT Duration Long Term Contract SKILLS REQUIRED Designing HiveHCatalog data model includes creating table definitions, file formats, compression techniques for Structured Semi-structured data processing Implementing Spark processing based ETL frameworks Implementing Big data pipeline for Data Ingestion, Storage, Processing Consumption Modifying the Informatica-Teradata Unix based data pipeline Enhancing the Talend-HiveSpark Unix based data pipelines Develop and Deploy ScalaPython based Spark Jobs for ETL processing ? Strong SQL DWH concepts Big Data (must have) Hadoop Hive HDFS Spark ? YARN DWH concepts SQL LinuxUnix (OS) Programming Language (must have). Should be proficient in at least one of the below language Scala Python Skills (Good to have) Informatica Talend Java Teradata MySQL Oracle Preferred background Function as integrator between business needs and technology solutions, helping to create technology solutions to meet clients’ business needs Lead project efforts in defining scope, planning, executing, and reporting to stakeholders on strategic initiatives Understanding of EDW system of business and creating High level design document and low level implementation document Understanding of Big Data Lake system of business and creating High level design document and low level implementation document Designing Big data pipeline for Data Ingestion, Storage, Processing Consumption
Job Detail
More jobs from our partners (343)
AmazonData Analyst on14 April 2021Any
LyftCompliance Data Analyst on12 April 2021Any
LyftFinancial Data Analyst, FP&A on12 April 2021Any
PelotonData Analyst, Integrated Business Planning Applications on15 April 2021Any
AppleAI/ML – Annotation Analyst, Norwegian Language on24 March 2021Any
AppleAI/ML – Annotation Analyst, Danish Language on13 March 2021Any
AppleSenior Reporting and Data Analyst on18 April 2021Any
AppleAI/ML – Annotation Analyst, Finnish Language on13 March 2021Any
AppleAI/ML – Sr Analyst, Market Intelligence on26 March 2021Any
PelotonData Analyst, Integrated Business Planning Applications on15 April 2021Any