Lead Data Engineer

IT
Colombo
February 21, 2025
රු100,000 - රු200,000
Full Time Private
Application deadline closed.

Job Description

Lead Data Engineer

We are seeking a talented and experienced Lead Data Engineer to play a critical role in designing, building, and optimizing scalable data architectures and pipelines. As a Lead Data Engineer, you will combine your expertise in data engineering, software development, and system integration to drive high-performance data solutions that support automation, IoT, data science, advanced analytics, and AI initiatives.

Responsibilities:

  • Lead the design and development of scalable, high-performance data engineering solutions based on business and functional requirements.
  • Oversee the end-to-end data pipeline lifecycle, ensuring efficiency, reliability, and compliance with best practices.
  • Optimize data ingestion, storage, and processing strategies, leveraging modern data platforms and frameworks.
  • Collaborate with Data Scientists, ML Engineers, and stakeholders to enable data-driven AI/ML solutions.
  • Define high-level architectures and drive data engineering best practices across teams.
  • Mentor and guide junior and mid-level data engineers, fostering knowledge sharing and skill development.
  • Ensure quality assurance, performance monitoring, and debugging of data solutions.
  • Represent the company in large-scale internal and external data projects, acting as a technical expert.
  • Stay ahead of emerging data engineering trends and advocate for their strategic adoption.
  • Provide technical mentorship, define best practices, and drive strategic data engineering initiatives.
  • Act as a subject matter expert in data platforms, pipeline orchestration, and performance optimization, contributing to large-scale internal and external projects.

Required Skills and Competencies:

  • Proven experience leading data engineering teams and projects.
  • Strong technical expertise in data pipeline architecture, data processing frameworks, and orchestration tools.
  • Hands-on experience with cloud-based data solutions (e.g., AWS, Azure, Google Cloud).
  • Proficiency in big data technologies, parallel processing frameworks, and data warehousing.
  • Strong programming skills in Python, Java, Scala, or SQL.
  • Deep understanding of database management, data modeling, and performance tuning.
  • Experience in designing scalable and secure data platforms.
  • Excellent problem-solving and analytical skills.
  • Strong leadership, stakeholder management, and communication skills.
  • Ability to drive best practices, mentor teams, and contribute to strategic data initiatives.

Education and Experience:

  • A University degree or equivalent professional qualification with at least 2 years of industry experience as a data scientist, or a master’s level degree in data science, is an essential prerequisite for all career levels.

Attributes:

  • Self-starter
  • Low fear of change
  • Ability to learn and adapt to new technologies quickly
  • Technical aptitude and understanding
  • Courage, able to take the initiative and remove barriers for a team
  • Able to work with a range of personalities and cultures

How to Apply

If you are interested in this position, please send your resume to careers@codfication.io.

Related Jobs