Senior Data Engineer

Job Overview

We are looking for a Data Engineer to join our new Data Analytics Initiatives. The role will be involved on building a unified data platforms for our clients. The candidate will work through data streaming, cleansing and processing for large Fortune 500 client. Responsibilities Prepare data to be ready for analytics including transforming from source raw data, cleaning missing data and outliers as well as imputing as necessary Create a streaming data platform for a real time consumption’s Work with the business to understand key goals and translate that into analytics requirements and implementations Work with the Data Scientist to understand the model and implementing to be production ready Required Skills Bachelor degree in Computer Science, Mathematics, or related fields At least continuous 4 years of experience with Spark, especially pySpark implementation. Understanding of Kafka-Yarn-Spark-HDFS ecosystem for ingestion. A working knowledge with Streaming Data infrastructure In depth knowledge of preparing large scale data analytics for consumption’s. Key knowledge on HIVE and query optimization in HIVE Banking experience related to risk management and analysis on Fraud is a plus. Career progression demonstrating early working experience with Hadoop and moving on to include Kafka and Spark later A Little about Photon Photon is the largest and fastest growing provider of Mobile First Omni-Channel Experiences. We work with over 30 of the Fortune 100 companies. Our omni-channel presence touch over 120 million consumers every day and we have the largest pool of omni-channel engineers with over 3,400 engineers across offices in US, India, Indonesia and the Netherlands. We are the dominant providers of omni-channel solutions for Fortune 100 companies. We define omni-channel today as broadly comprising of 5 prominent areas – Consumer Facing Mobile Applications Associate or Employee Facing Mobile Applications Adaptive Responsive Web Presences In-Store Digital Presences. API Platforms Blueprints.