Big Data Engineer/ SQL, SCALA, API

Job Overview

Description: Design, develop and execute Apache Spark analytical jobs across several data sources and types, utilizing both Java and Scala and interfacing with Apache Cassandra; will be designing and developing RestFUL Java API’s. Exposure and/or development with messaging technologies (Kafka) is a plus. Updating and building standards around data ingestion and processes within the analytics ecosystem for scalable and maintainable platforms. Identification of currently inefficient processes and data flows and proposed future state, passionate about data quality and performance. Full grasp of continuous integration and delivery, including branching strategies, automated unit tests, static analysis (code structure and security), automated deployment and functional automation within CI Pipelines. Education And Experience 8+ years of experience in one or more of the following disciplines: data analysis, software engineering or database development. Experience working in an agile development environment encouraged (Scrum and/or Kanban). BS/BA or proven analytical and technical ability. Deep understanding how data supports business strategy, and how it is used within business processes and its impact. Experience working with analytic and partner to understand and propose solutions and approaches to sophisticated analytic problems. Exposure to DataStax Enterprise (Cassandra and Spark). Nice to have: Experience with large-scale data sets (50+ terabytes .. 1+ petabyte); exposure to Relational Database and traditional ETL Tools (Oracle, Informatica). Proficient in SQL, Java, ScalaStrong working DevOps techniques and basic project management skills Job Requirements:Requirements: 6+ years of experience in one or more of the following disciplines: data analysis, software engineering or database development. Experience working in an agile development environment encouraged (Scrum and/or Kanban). Thrive in a multifaceted, fast paced, highly upbeat TEAM based environment. Design, develop and execute Apache Spark analytical jobs across several data sources and types, utilizing both Java and Scala and interfacing with Apache Cassandra; will be designing and developing RestFUL Java API’s. Exposure and/or development with messaging technologies (Kafka) is a plus. Updating and building standards around data ingestion and processes within the analytics ecosystem for scalable and maintainable platformsBig Data Engineer/ SQL, SCALA, API 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.