Lead Data Engineer

John Hancock
John Hancock

Job Overview

Are you looking for unlimited opportunities to develop and succeed?  With work that challenges and makes a difference, within a flexible and supportive environment, we can help our customers achieve their dreams and aspirations.Job DescriptionAre you a go-getter who has a passion in building next gen data pipelines and provide Big data solution for business problems? Are you a big fan of simplification and automation?Manulife is seeking an awesome Lead Data Engineer, with Big Data experience as well as strong understanding of data-ingestion, data curation and both Batch & Stream Data processing, to join our rapidly expanding IT Organization and assist us as we work to be a digital leader in our industries!Skills and ExperienceYou will have the following skills and experience:Lead development teams to define and build data pipelinesExpert in building and operationalizing BigData platforms in cloud using one of the public clouds, preferably MS Azure.Hands on experience with Big Data streaming frameworks and tools (Spark Streaming, Storm, Kafka, etc.)Expert in Hadoop ecosystem and toolset – Sqoop, Nifi, Pig, Spark, HDFS, Hive, HBase, etc.Expert in automating data pipelines in a Big Data ecosystem, DevOps and CICD.Experience in developing Hadoop integrations (batch or streaming) for data ingestion, data mapping and data processing capabilitiesExperience programming in both compiled languages (Java, Scala) and scripting languages (Python or R)Expert in developing Big Data set processes for data modeling, mining and productionExperience in working with key partners including business and technology to establish definition of success, goals, key use cases and aligning dev team on strategic priorities.Excellent communication and interpersonal skillsExcellent analytics, problem solving and solutioning skillsA capacity for constant learning from both success and failure, remaining open to change and continuous improvementGood to HavesExperience in Exploratory data analysis; Query and process Big Data, provide reports, summarize and visualize the dataExperience in Canary deployments, 0-downtime, 0-dataloss, hot-hot DRExperience in designing solutions for Big Data warehousesExperience with Hadoop security frameworks like Knox, Ranger.Experience with Hadoop metadata frameworks and security policies such as Ranger, AtlasExperience in data profiling and analysisExposure to and an understanding of Agile scrum methodologies and experience of working in an Agile teamExperience in Big Data performance analysis, tuning and capacity planningExperience in designing business intelligence systems, dashboard reporting, and analytical reporting is a plusExperience with the Hortonworks Data Platform (version 2.5)Experience in using Git flow.Basic understanding of following will be useful but not required:Exposure to and basic understanding of collaboration tools like Slack, Skype, Teams, and JIRAWhataboutPerks?Manulife has lots of perks including, but not limited to:Competitive compensationRetirement Savings Accounts including a RPP (Pension Plan), RRSP (Retirement Savings Plan), and TFSA (Tax Free Savings account)Manulife Share Ownership Program with employer matchingCustomizable Benefits Package including Health, Dental, Vision, and 100% of Mental Health expensesFinancial support for ongoing training, learning, and educationMonthly Innovation Days (Hackathons)Wearing jeans to work every dayAn abundance of career paths and opportunities to advanceA flexible work environment with flex hours, work from home arrangements, distributed teams, and condensed work week arrangements.This is a full time permanent role and the team is located in Kitchener/Waterloo, Ontario. There is opportunity for Toronto based people to work in this role, however there would be travel to Kitchener / Waterloo twice per week.We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.About ManulifeManulife Financial Corporation is a leading international financial services group that helps people achieve their dreams and aspirations by putting customers’ needs first and providing the right advice and solutions. We operate primarily as John Hancock in the United States and Manulife elsewhere. We provide financial advice, insurance, as well as wealth and asset management solutions for individuals, groups and institutions. At the end of 2017, we had approximately 34,000 employees, 73,000 agents, and thousands of distribution partners, serving more than 26 million customers. As of December 31, 2017, we had over $1.04 trillion (US$829.4 billion) in assets under management and administration, and in the previous 12 months we made $26.7 billion in payments to our customers. Our principal operations are in Asia, Canada and the United States where we have served customers for more than 100 years. With our global headquarters in Toronto, Canada, we trade as ‘MFC’ on the Toronto, New York, and the Philippine stock exchanges and under ‘945’ in Hong KongIf you are ready to unleash your potential it’s time to start your career with Manulife/John Hancock.About ManulifeManulife Financial Corporation is a leading international financial services group that helps people make their decisions easier and lives better. We operate primarily as John Hancock in the United States and Manulife elsewhere. We provide financial advice, insurance, as well as wealth and asset management solutions for individuals, groups and institutions. At the end of 2018, we had more than 34,000 employees, over 82,000 agents, and thousands of distribution partners, serving almost 28 million customers. As of March 31, 2019, we had over $1.1 trillion (US$849 billion) in assets under management and administration, and in the previous 12 months we made $29.4 billion in payments to our customers.Our principal operations in Asia, Canada and the United States are where we have served customers for more than 100 years. With our global headquarters in Toronto, Canada, we trade as ‘MFC’ on the Toronto, New York, and the Philippine stock exchanges and under ‘945’ in Hong Kong.Manulife is an equal opportunity employer.   We strive to attract, develop and retain a workforce that is as diverse as the customers we serve and to foster an inclusive work environment that embraces the strength of cultures and individuals.  We are committed to fair recruitment, retention and advancement and we administer all of our practices and programs based on qualification and performance and without discrimination on any protected ground. It is our priority to remove barriers to provide equal access to employment.  A Human Resources representative will consult with applicants contacted to participate at any stage of the recruitment process who request any accommodation. Information received regarding the accommodation needs of applicants will be addressed confidentially.Full time

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.