Big Data Solutions Architect

Spearhead Staffing
Spearhead Staffing

Job Overview

We are seeking a Big Data Solutions Architect for a direct hire role in Wayne, NJ (07470). Compensation depends upon experience level. The Big Data Solutions Architect designs and executes solutions for complex financial banking business problems involving batch real-time advanced analytics and reporting solutions. Negotiates solution trade-offs with Business Technology stakeholders for using the right tools and datasets when and where they make sense and for creating an intuitive next-generation big data applications platform that helps effectively analyze and process structured and unstructured data. Design and implement data and analytics solutions to meet immediate business needs, while aligned with future state architecture and industry trends Architect and design Big Data Services in the cloud with fit for purpose considerations for cloud products and services Develop engineering search and catalog capabilities for Big Data analytics Improve the data quality framework for Big Data Create an end-to-end vision of how data will flow through an organization. Provides guidance to data engineering team and feedback to application, infrastructure security solution architects towards holistic viewpoints Develop data models for database structures Provide hands-on guidance and oversight on all aspects of information solution delivery. Work closely with client technical and business stakeholders to shape the success of Big Data projects. Negotiates scope, budget, and quality-based trade-offs with stakeholders towards long-term architecture alignment Evaluates and selects the appropriate technology for Machine Learning KNOWLEDGE, SKILLS, AND ABILITIES Experience in developing Use Cases for Data Management, Access, Analytics and Governance Experience in architecting, designing, reviewing, implementing, and optimizing data transformation processes in the Microsoft Azure ecosystem using PaaS and IaaS products and services. Continuously learns and updates oneself on the new releases on products and services by leading Cloud solution providers (like Microsoft Azure, Amazon Web services etc.) Able to consolidate, validate and cleanse data from a vast range of sources ndash from applications and databases to files and Web services. Experience working in Sales Marketing and Servicing domains using platform Strong experience using Cloudera Enterprise on Microsoft Azure, LinuxUNIX Commands, Hive, Pig, Impala Ability to use Data Ingestion tools, Kafka Broker Services, Flume, Spark, Sqoop, MapReduce Knowledge of Hadoop Distributed File System HDFS Hive, Apache Kudu, HBase Knowledge of Security Architecture for Cloudera Enterprise on MS Azure Strong experience using Relational non-relational, NoSQL and HBase databases Knowledge of YARN, Zookeeper Knowledge of Cloudera Manager Knowledge of Trifacta Data Wrangling Knowledge of Java, Python Knowledge of Data Visualization tools, MS Power BI Knowledge of container managed functions – Docker and Kubernetes Knowledge of data security, privacy, and obfuscation with reference to distributed cloud architecture Knowledge of API integration (preferably MuleSoft) Strong experience using Agile, Scrum methodology Experience in Agile BI delivery within the financial industry EDUCATION AND CERTIFICATION BS in computer science or a related IT degree with a minimum of 7 years of information technology experience designing and managing Business Intelligence Projects with a minimum of 3 years working with Big Data projects. Must have Relational and non-relational database experience. Cloudera certification, Microsoft Azure ArchitectData Certification a plus Please note This position is not open to 3rd party c2c agencies. No visa sponsorship provided. All applicants must have permanent US work authorization and not require sponsorship now or in the future. Locals daily commuting distance only please no remote or relocation.Big Data Solutions Architect 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.