Big Data Developer

Application deadline date has been passed for this Job.

Job Overview

Looking for a Big Data Developer with experience in Hadoop, HDFS, Apache OpenSource, Airflow or Spark. Highlights Work with a world-class team at the forefront of edge-based Machine Learning Great opportunity to contribute, learn, and grow your multi-disciplinary skills Mainstream imaging and audio artificial intelligence at the edge Reports to Senior Director of Data Management The Position This is not your ordinary architect developer opportunity. This is a chance for a candidate who has the right balance of capabilities in data pipeline and storage architecture. This opportunity spans the responsibilities of implementing custom data configuration, data infrastructure innovation and data pipeline development. You will be designing and developing data solutions for an enterprise and international machine learning program. We are changing the rules of the ML game, from groundbreaking new theoretical approaches to the most power-efficient edge inference engine on the planet. See the results of your work in millions of consumer electronics products. Job Description Architect and integrate data versioning platforms like DVC. Similar to Get for code Architect and develop international MAM and DAM data platforms and integrations for digital other ML assets Architect, integrate and implement data transfer software like Aspera vs Signiant Architect, integrate and implement workflow management with Airflow, Luigi or Jenkins Develop API data connection with NAS, RAID, cloud and HDSF data stores Develop application Rest API and web service SOAP APIs integrations Script SQL and NoSql queries for acquiring, retrieving and augmenting data assets and metadata from NAS, DynamoDB, MongoDB, Snowflake, S3 and Blob storage Python scripting for workflows, jobs, ETLs and machine learning execution Architect and integrate enterprise NAS storage Familiarity with Pytorch andor TensorFlow frameworks Creation, population and maintenance of XML and JSON data schemas Develop and automate third party application rest APIs Scripting of runtime languages like Node.js Architect and implementation Kubernetes and Docker integrations Architect and support code GPU ML infrastructure and data integrations Architect and support data backups, replication and failover Architect and implement message queuing and process flows via Kafka, RabbitMQ Architect and implement of Linux servers, load balances, and server farms Architect and implement solutions to monitor, performance tune, alert and troubleshoot GPU, ML data augmentation, ML processes and data flow jobs Architect and implement AWS cloud infrastructure like Lambda functions, Kinesis, EMR, S3, S3 Glacier andor AZURE Functions, AWS BLOB Expertise in normalized de-normalized data and when to use each schema Expertise in structured, semi structured, and unstructured data storage and pipelines Architect and implement Apache solutions like (Hadoop, HIVE, Spark Flum, Airflow, Flink) Expertise in PII data tagging, workflows and categorization (GDPR, CCPA) Expertise in general data security, encryption, retention and access workflow Implementation of distributed computing platforms Experience using Atlassian tools like Jira and Confluence, plus Bitbucket and Git for version control. Familiar with development methodologies such as AgileKanban Nice to have Experience with open core, state monitoring software like Puppet on Ruby Experience with Snowflake and other MPP columnar storage SaaS solutions Experience with R Studio, Matlab, Databricks or Anaconda ML solutions Experience with data management for entertainment and SVODAVOD streaming Experience with live streaming gaming or esports data collection and analytics Experience architecting UI interfaces for custom Https applications Requirements BS or MSc degree in a relevant field with at least 3 years relevant industry experience Experience as a data architect designing and implementing enterprise data platforms Experience as a handson developer with Python, SQL, Linux scripting Detail orientation with strong analytical and troubleshooting skills Self-motivated and focused Comfortable collaborating with geographically dispersed teams Excellent written and spoken communication skills Conversant in machine learning fundamentals Take pride in finding ways to engineer things better, faster and correct. A focus on automation The Location Calabasas CA, or San Jose CABig Data Developer 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.