REMOTE :: Big Data Engineer || Long Term Contract || Thousand Oaks, CA

IT First Source
IT First Source

Job Overview

Position Big Data Engineer Location Thousand Oak, CA (REMOTE as of now) Duration Long Term Contract Job Description bull Create and maintain optimal data pipeline architecture, bull Assemble large, complex data sets that meet functional non-functional business requirements. bull Identify, design, and implement internal process improvements automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. bull Build the infrastructure required for optimal ingestion, transformation, and Publishing of data from a wide variety of data sources using PythonSpark and AWS lsquobig datarsquo technologies. bull Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. bull Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs. bull Keep our data separated and secure across national boundaries through multiple data centers and AWS regions. bull Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader. bull Work with data and analytics experts to strive for greater functionality in our data systems Experience Requirements bull Advanced working SQL,PythonPySpark knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. bull Experience building and optimizing lsquoCloud big datarsquo data pipelines, architectures and data sets. bull Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. bull Strong analytic skills related to working with unstructured datasets. bull Build processes supporting data transformation, data structures, metadata, dependency and workload management. bull A successful history of understanding, processing and extracting value from large disconnected datasets. bull Working knowledge of message queuing, stream processing and highly scalable lsquobig datarsquo data stores. bull Understating of various data sets Structured ,Semi Structured ,Data at rest Motion bull Experience in Data Modeling bull Strong project management and organizational skills. bull Experience supporting and working with cross-functional teams in a dynamic environment. and knowledge of one or more from the below bull Experience with big data tools Hadoop, Spark, Kafka, etc. bull Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. bull Experience with data pipeline and workflow management tools Apache NiFi,AWS Step Function ,Oozie,Azkaban, Luigi, Airflow, etc. bull Experience with AWS cloud services EC2, EMR, RDS, Redshift bull Experience with stream-processing systems AWS DMS, Kinesis, Spark-Streaming, etc. bull Experience with object-orientedobject function scripting languages Python, Java, C++, Scala, etc. IT First SourceREMOTE :: Big Data Engineer || Long Term Contract || Thousand Oaks, CA 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.