Jobs Lanka - Find Your Dream Job
← All jobs

Job details

Orysys Limited is seeking a highly skilled and experienced Data Engineer to lead the architecture, design, and deployment of our enterprise data infrastructure. You will bridge the gap between data engineering, backend services, and machine learning operations (MLOps).

Position Summary

  • Role: Data Engineer

  • Company: Orysys Limited

  • Location: Sri Lanka

Key Responsibilities

  • Pipeline Architecture: Architect and build highly scalable, fault-tolerant ETL/ELT pipelines from scratch.

  • Big Data Ecosystems: Design and manage open-source big data environments using Hadoop, Apache Spark, Kafka, and NiFi for high-throughput, real-time, and batch data processing.

  • Backend & API Integration: Lead backend development for data serving using Python FastAPI and Spring Boot, and secure APIs utilizing OAuth2 protocols.

  • Orchestration & Transformation: Utilize Apache Airflow for complex workflow orchestration and dbt for robust data transformation.

  • DevOps & Infrastructure: Apply knowledge of Docker, Kubernetes, Linux commands, and network configurations for seamless deployments.

  • MLOps & Advanced Data: Support MLOps practices for model deployment and monitoring, and handle complex time-series data storage and analysis.

Requirements & Qualifications

  • Experience: Minimum 3+ years of hands-on experience in Data Engineering.

  • Programming: Strong proficiency in Python, with solid experience in backend frameworks like FastAPI and Spring Boot.

  • Big Data & Streaming: Experience with Hadoop environments, Apache Spark, Kafka, and Airflow as must-have requirements.

  • ETL/Orchestration: Deep expertise in ETL pipeline creation, productionizing data workflows, Airflow, and dbt (not mandatory).

  • Databases: Advanced SQL skills with deep knowledge of DB2 SQL and PostgreSQL, capable of handling massive time-series datasets (work experience in IBM AS400 is advantageous).

  • Infrastructure & Security: Proficiency with Linux CLI, Docker, Kubernetes, network configuration, and OAuth2 implementation.

  • MLOps: Proven knowledge and hands-on experience with MLOps principles and productionizing machine learning workflows.

  • Cloud & Domain Exposure: Exposure to Google Cloud Platform (GCP) services and architecture (or any other vendor); banking domain experience is advantageous.

How to Apply

Interested candidates should send their applications to the email address below:

Orysys Limited

Sri Lanka

Apply Now →