Big Data Developer

Job Overview

Position Big Data Developer Location NYNJ and Atlanta, GA Interview Type Phone Skype Visa Type , GC, GC-EAD and NO H1B OPT Duration Long Term Contract SKILLS REQUIRED Designing HiveHCatalog data model includes creating table definitions, file formats, compression techniques for Structured Semi-structured data processing Implementing Spark processing based ETL frameworks Implementing Big data pipeline for Data Ingestion, Storage, Processing Consumption Modifying the Informatica-Teradata Unix based data pipeline Enhancing the Talend-HiveSpark Unix based data pipelines Develop and Deploy ScalaPython based Spark Jobs for ETL processing ? Strong SQL DWH concepts Big Data (must have) Hadoop Hive HDFS Spark ? YARN DWH concepts SQL LinuxUnix (OS) Programming Language (must have). Should be proficient in at least one of the below language Scala Python Skills (Good to have) Informatica Talend Java Teradata MySQL Oracle Preferred background Function as integrator between business needs and technology solutions, helping to create technology solutions to meet clients’ business needs Lead project efforts in defining scope, planning, executing, and reporting to stakeholders on strategic initiatives Understanding of EDW system of business and creating High level design document and low level implementation document Understanding of Big Data Lake system of business and creating High level design document and low level implementation document Designing Big data pipeline for Data Ingestion, Storage, Processing Consumption