Big Data Engineer

Elan Partners
Elan Partners

Job Overview

Title Big Data Engineer Summary The Big Data Engineer provides data and reporting development services andor technical support daily. Our Data Engineers also maintain data or reporting solutions (data warehousemartstoresdata lakeanalytics) using tools and programming languages. Develop data set processes, assist with design and identify ways to improve data, efficiency and quality. Responsibilities include requirement analysis, code, test, debug, document and maintain data and analytics solutions. Responsibilities bull Create data warehouses (very large databases, usually loaded from transaction and Enterprise Resource Planning ERP systems to support decision-making in an organization) and data marts (a subset of a data warehouse for a single department or function) bull Develop data mining tools and analyze to sift through large amounts of data stored in a data warehouse or data mart to find relationships and patterns Requirements bull 4+ years of experience in Data Engineering with SQL, Python experience with relational SQL and NoSQL databases experience in the following Big Data frameworks File Format (Parquet, AVRO, ORC etc.) bull 3+ years working with large data sets, streaming, experience working with distributed computing (Map Reduce, Hadoop, Hive, Apache Spark, Apache Kafka etc.) bull Working knowledge of data structures, SQL, XML, JSON, Data visualization tools, Version Control Systems, Programming, and UnixLinux shell scripting experience with AWS, GCP or Azure bull Experience with RESTful API development, Familiarity with HTTP and invoking web-APIs bull An Associatersquos degree andor Bachelor’s degree a plus bull Certified Business Intelligence Professional (CBIP) or equivalent certification bull Equivalent education andor experience may be substituted for any of the above requirements Benefits Competitive Overall Benefit Plan, 401K Match, Pension, flexible work environment, free parking and more!Big Data Engineer 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.