Data Engineer

Apex Systems
Apex Systems

Job Overview

Title- Data Engineer Client- Large Financial Institute Location- Manhattan, NYC Duration- 12+ Month Contract with Potential to ExtendConvert Description Summary Financial regulation for banks has increased dramatically over the past few years. This role is to work on the Global Banking and Markets (GBAM) Non-Financial Regulatory Reporting (NFRR) Data Delivery program, a new initiative to define and implement consistent and efficient regulatory reporting processes that adhere to enterprise standards, simplify controls and enable re-use. As part of this initiative, we are developing a Data Processing Framework using Scala and Big Data technologies for authoring domain-specific-language (DSL) components to seamlessly combine data from multiple data sources. The DSL components interpret transformation rules written in a configuration style syntax that can be applied to one or more standard data sets to produce a transformed data set. This framework provides a unified language for describing the data needs of a report. bull Enables users to seamlessly retrieve and combine data from multiple sources bull Enables users to author reports without having to worry about the mechanics of actually retrieving, filtering, projecting, or aggregating the data bull Ensures proper versioning of the report definitions and the running of the reports as they existed at specific points in time bull Ensures that the system is scalable enough to run hundreds of reports in parallel, if require Role We are looking for a Scala developer with Apache HadoopSparkFlink experience to assist with the development of the regulatory reporting processing engine using Scala and Big Data technologies to provision regulatory reporting data via domain-specific-language (DSL) scripts. The role requires close partnership with the NFRR Program analysis and development teams. Responsibilities The candidate will work directly with the Director of the Data Processing Engine and will participate in all phases of development of the platform and subsequent reports. bull Develop technical specification and component level design for DSL Extensions for input and output bull Design parameterized and configurable modules for DSL Extensions bull Develop DSL for the data outputs needed for NFRR Reports bull Integrate Code Repository and Management Qualifications The candidate must be a self-starter, able to work in a fast paced and results driven environment with minimal oversight. The candidate is required to have excellent communications skills and possess a strong sense of accountability and responsibility. bull 5+ years development experience bull Good general Scala programming skills bull Experience with Hadoop Distributed File System (HDFS), HBase and Hive bull Experience with custom aggregations within SparkFlink, preferred bull Experience with databases, a plus bull Experience on regulatory or reporting projects, preferred bull Ability to perform detailed and complex data analysis bull Attention to detail and ability to work independently bull Ability to handle tight deadlines, and competing demands in a fast paced environment bull Knowledge of Global Banking and Markets’ productsasset classes and associated data including fixed income, equities, derivatives, and foreign exchange securities, preferred Scala developer with Apache HadoopSparkFlink experience 5-7 years If you are interested in applying to this position or learning more please reach out to Yasmin Aminyar directly at . EEO Employer Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at orData Engineer 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.