Lead Data Engineer

Enquero
Enquero

Job Overview

ABOUT THE COMPANY We are the Gen-Next technology solution provider, solving complex business problems. We assist our happy customers across all spectrum to reimagine their business processes and navigate their digital journey. Our out-of-the-box solutions continue to bridge the gap between ideas and reality, delivering impact through connected data, architecture and experience. WE ARE ENQUERO – DIGITALLY TRANSFORMING businesses since 2014! Excellence with Enquero We are a vibrant and a ridiculously norm-challenging bunch with increasingly diverse teams across the globe. Our open culture enables easy ideation, innovation and delivery. Our voracious appetite for knowledge makes growth organic to us. If you have a passion for problem solving and quirkiness doesnrsquot scare you, come be a part of our rapidly growing company. Oh! we do have a life outside work as well. RESPONSIBILITIES Engaging in problem solving and actively supporting data engineering analytics processes. Contributing towards documentation (e.g. of data, proposals) to enhance overall work output. Performing hands-on DevOps work, wherever applicable, to keep the Data platform product more secure and reliable. Performance tuning of Big Data workloads. Write highly tuned and performant SQLs on various DB platform including MPPs. Develop highly scalable, fault tolerant, maintainable ETL data pipelines to handle vast amount of data. Build high quality, unit testable code. Operationalize data ingestion, data transformation and data visualization for enterprise use. Define architecture, best practices and coding standards for the development team. Provides expertise in all phases of the development lifecycle from concept and design to testing and operation. Work with domain experts, engineers, and other data scientists to develop, implement, and improve upon existing systems. Deep dive into data quality issues and provide corrective solutions. Interface with business customers, gathering requirements and deliver complete Data Engineering solution. Ensure proper data governance policies are followed by implementing or validating Data Lineage, Quality checks, classification, etc. Deliver quality and timely results. Mentor and train junior team members and ensure coding standard are followed across the project. Help talent acquisition team in hiring quality engineers. Engage in external tech community (writing blogs, contributing to open source etc). QUALIFICATIONS Required Minimum 7+ years of experience in design, development, and deployment of large-scale, distributed, and cloud-deployed software services. Bachelorrsquos in Computer Science or related disciplines Must have been part of minimum 2 end to end big data projects and must have handled defined modules independently. Expert in SQL and good with data modelling for relational, analytical and big data workloads. Advanced programming skills with Python, Scala or Java. Strong knowledge of data structures, algorithms, distributed systems. Strong experience and deep understanding of Spark internals. Expert in Hive. Hand on experience with one of the cloud technologies (AWS, Azure, GCP). Hands on experience with at least one NoSQL database (HBase, Cassandra, MongoDB etc). Experience in working with both batch and streaming datasets. Knowledge of at least one ETL tool like Informatica, Apache NiFi, Airflow, DataStage etc. Experience in working with Kafka or related messaging queue technology. Hands on experience in writing shell scripts for automating processes. Willingness to learn and adapt. Delivery focused and willingness to work in a fast-paced work environment. Takes initiative and responsibility for delivering complex software. Knowledge of building REST API end points for data consumption. Excellent oral and written communication is a must. Well versed with Agile methodologies and experience in working with scrum teams. Preferred Master’s in Computer Science or related disciplines Experience building self-service tools for analytics would be plus. Knowledge of ELK stack would be a plus. Knowledge of implementing CICD on the pipelines is a plus. Knowledge of Containerization (DockerKubernetes) will be plus. Knowledge of building RESTful services would be an added advantage. Experience working with one of the popular Public Cloud based platforms. DISCLAIMER This job description is intended to describe the general nature of the work performed by employees in this job. It is not an exhaustive list of all the job’s responsibilities. At Enquero, all of our jobs include broad responsibilities for continually improving the processes we use to develop our products. Enquero is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.Lead Data Engineer 1

View More
Job Detail
Shortlist Never pay anyone for job application test or interview.