Senior Big Data Engineer


Job Overview

What youll be doing…The Visible Engineering team is seeking a Senior Data Engineer to work with a small team responsible for building, deploying, and supporting a Big Data solution that will enable operations for a large enterprise environment. You will design, build and maintain Enterprise Level Data Pipe-Lines utilizing the tools available within the Big Data Eco-System. As a Senior Big Data Engineer – You will work on Advanced Analytics using Big Data technologies such as Hadoop and Data Warehousing.+ Build analytical solutions to enable Data Scientist by manipulating large data sets and integrating diverse data sources.+ Perform ad-hoc analysis and develop reproducible analytical approaches to meet business requirements.+ Perform exploratory and targeted data analyses using descriptive statistics and other methods.+ Use complex algorithms to develop systems & applications that deliver business functions or architectural components.+ Work closely with the data scientists, and database and systems administrators to create data solutions.+ Follow best practices on design and implementation to aid in company-wide data governance.+ Improve existing data pipelines by simplifying and increasing performance.+ Design, build, and deploy new data pipelines within Big Data Eco-Systems.+ Documents new/existing pipelines, Data Sets and Data Sets.+ Abides by department development standards and SOP’s.+ Attends all department meetings.+ Keeps updated on latest technologies relevant to positions duties.+ Keeps management updated on projects and assigned work.What were looking for…Youll need to have:+ Bachelors degree or four or more years of work experience.+ Six or more years of relevant work experience.Even better if you have:+ Experience of designing, building, and deploying production-level data pipelines using tools from Hadoop stack (HDFS, Hive, Spark, HBase, Kafka, NiFi, Oozie, Splunk etc.).+ Experience with various noSQL databases (Hive, MongoDB, Couchbase, Cassandra, Neo4j).+ Experience with analytic or feature engineer programming (python or scala or java).+ Experience implementing open source frameworks & exposure to various open source & package software architectures (AngularJS, ReactJS, Node, Elasticsearch, Spark, Scala, Splunk, Apigee, and Jenkins etc.).+ Experience troubleshooting JVM-related issues.+ Experience with SQL databases and Change Data Capture.+ Experience and strategies to deal with mutable data in Hadoop.+ Experience with Stream sets.+ Experience of Agile and DevOps methodologies.+ Experience in full development life cycle and significant experience in delivering applications and architecture services.+ Experience in data visualization tools like Kibana, Grafana, Tableau and associated architectures.+ Experience evaluating and implementing cutting-edge digital technologies.+ Experience with Cloud technologies (AWS, GCP, PCF, Docker, Kubernetes and application migration.When you join Verizon…Youll have the power to go beyond doing the work thats transforming how people, businesses and things connect with each other. Not only do we provide the fastest and most reliable network for our customers, but we were first to 5G – a quantum leap in connectivity. Our connected solutions are making communities stronger and enabling energy efficiency. Here, youll have the ability to make an impact and create positive change. Whether you think in code, words, pictures or numbers, join our team of the best and brightest. We offer great pay, amazing benefits and opportunity to learn and grow in every role. Together well go far.Equal Employment OpportunityWe’re proud to be an equal opportunity employer – and celebrate our employees’ differences, including race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, and Veteran status. Different makes us better.REQNUMBER: 546305-1E

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.