Big Data Developer at Atlanta, GA,New York,NY.

Avance Consulting
Avance Consulting

Job Overview

Big Data Developer Atlanta, GA,New York,NY Fulltime Primary responsibilities Designing HiveHCatalog data model includes creating table definitions, file formats, compression techniques for Structured Semi-structured data processing Implementing Spark processing based ETL frameworks Implementing Big data pipeline for Data Ingestion, Storage, Processing Consumption Modifying the Informatica-Teradata Unix based data pipeline Enhancing the Talend-HiveSpark Unix based data pipelines Develop and Deploy ScalaPython based Spark Jobs for ETL processing Strong SQL DWH concepts Preferred background Function as integrator between business needs and technology solutions, helping to create technology solutions to meet clientsrsquo business needs Lead project efforts in defining scope, planning, executing, and reporting to stakeholders on strategic initiatives Understanding of EDW system of business and creating High level design document and low level implementation document Understanding of Big Data Lake system of business and creating High level design document and low level implementation document Designing Big data pipeline for Data Ingestion, Storage, Processing Consumption Tools Technologies Big Data (must have) Hadoop Hive HDFS Spark YARN DWH concepts SQL LinuxUnix (OS) Programming Language (must have). Should be proficient in at least one of the below language Scala PythonBig Data Developer at Atlanta, GA,New York,NY. 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.