Senior Data Engineer

Blackstone Talent Group
Blackstone Talent Group

Job Overview

Blackstone Talent Group, an award-winning technology consulting and talent agency is seeking a Senior Data Engineer to join our team at our client’s site in Quantico, Virginia.A Data Engineer will focus on design, implementation and operation of the data management systems to meet the customer’s business needs. This includes designing how the data will be stored, consumed, integrated and managed by different data entities and systems. Data Engineer will work together with data consumers to determine, create and populate optimal data architecture, structures and systems. Data Engineer will also plan, design, and optimize for data throughput and query performance issues. Additionally, Data Engineer will have a vital role in the selection of backend database technologies, configuration and optimization of the full data pipeline infrastructure to support the content, volume of data and its ETL process.Responsibilities:Build, optimize, monitor and maintain data ETL/ELT pipeline.Build, configure and maintain Data Warehouse.Automate effective metadata management, leveraging modern tools and methods.Utilize Python, Scala or Java to collect data and analyze large-scale datasets in batch and real-time.Design scalable processes that support data transformation and structures, metadata, dependency and workload management.Collaborate with team members to design build and deliver innovative solutions.Establish data policies, standards, and procedures that improve data quality, availability, accessibility, security, usability, and enforcement of enterprise information management (EIM) program requirements.Recommend solutions based on performing industry-specific analysis, such as case studies describing data management best practices, identifying trends across the industry.Make recommendations to improve the efficiency and effectiveness in how NCIS acquires, stores, manages, shares and applies its data.Required Qualifications:Strong ability to design, build, optimize and manage data pipelines for data structures encompassing, Data Transformation, Data Models, Schemas, Metadata and workload management10+ Experience in data management disciplines including [data integration, modeling, optimization and data quality], and/or other areas directly relevant to data engineering responsibilities and tasks.Strong experience with advanced analytics tools for Object-oriented/object function scripting using languages such as R, Python, Java, and C++.Strong experience with database programming languages including SQL, PL/SQL Hadoop for relational and non-relational databasesProven experience with taking large data projects from conception to implementationExperience in working with both open-source and commercial message queuing technologies such as Kafka, JMS, Azure Service Bus, Amazon Simple queuing Service.Desired Qualifications:Experience with various cloud platform, cloud services, toolsManaged cloud-based data warehouseExperience with BI tools: PowerBI (preferable), TableauBasic Qualifications:Required Education: Bachelor’s or master’s degree in computer science, engineering or a related quantitative field [or equivalent work experience].Required Years of Experience: 10+ years of relevant experienceRequired: Any of the following within three (3) months of coming on board would be at a minimum: Security+ (CE), GSEC, SSCP, CISSP, GSLC, CISMRequired: Candidates can be SCI-eligible, but must have their SSBI at a minimum of SECRET.EOE of Minorities/Females/Veterans/DisabilitiesSenior Data Engineer 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.