Senior Big data Engineer

KoreMinds LLC
KoreMinds LLC

Job Overview

Position Big data Architect Engineer Location Columbus, Plano and Jersey city Duration 12+ months contract to perm (fulltime) Job Description Working with our LOB (line of business) users, collaborate with other technology teams to design, develop, test full stack cloud data solutions. Leading and be responsible for the craftsmanship, security, availability, resilience and scalability of your solution. Leading the innovation, perform proof of concept and the implementation of cutting-edge technologies BSBA degree or equivalent experience 5+ years of experience in application development using any of these programming languages Java, Scala, Python. Experience working in financial industry is preferred. 3+ years of experience working with Amazon Web Services (AWS) including entitlement and IAM policy. AWS professional certification is preferred. 3+ years of experience working on streaming data applications (Spark Streaming, Kafka, Kinesis, and Flink) 3+ yearsrsquo experience working with data pipeline open source products (Ex Airflow, Jupyter, etc) 3+ yearsrsquo hands-on experience with Hadoop data platform (MapReduce, Pig, Hive, HBase, Impala), experience working with Cloudera stack is preferred. 1+ years of experience with DevOps automation tools (AWS CloudFormation, Terraform) 1+ years of experience in developing, deploying and monitoring in building large distributed and parallel systems using container technology including Docker, Kubernetes, AWS EKS, AWD Fargate Lead by influence, mentor junior software engineers, ability to navigate to different teams and business to find solutions to complex Bigdata Cloud AWS Spark Scala Hadoop Java MapReduce Pig HBase Cloudera DevOps Docker AirFlow DataLakeSenior Big data Engineer 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.