Senior Data Platform Engineer

2 days ago


Singapore Tech Aalto Full time $120,000 - $180,000 per year
Job Summary:

We are seeking an experienced Senior Data Platform Engineer with over 15 years of expertise in managing and administering complex data and compute infrastructure across on-premises and cloud environments. The ideal candidate will have deep hands-on experience with Kubernetes (on-prem & Azure)Spark Clusters, and CI/CD pipelines using Azure DevOps, with a strong background in modern data platform tools including Apache Ranger, Kafka, Airflow, Trino, Iceberg, and Datahub.

Key Responsibilities:
  • Administer and maintain on-prem Kubernetes environments using in-house Kubernetes packages, as well as Azure Kubernetes Service (AKS) clusters.
  • Provision, configure, monitor, and manage Apache Spark clusters for large-scale data processing.
  • Implement and support CI/CD pipelines using Azure DevOps (ADO) for data platform components and infrastructure.
  • Ensure secure and governed data access using Apache Ranger and other security tools.
  • Support and manage distributed data systems such as Kafka, Trino, Airflow, Iceberg, and Datahub.
  • Monitor system health, identify performance bottlenecks, and perform root cause analysis for infrastructure and platform issues.
  • Collaborate with DevOps, Data Engineering, and Cloud teams to optimize the scalability, performance, and resilience of the platform.
  • Maintain infrastructure as code (IaC) practices and participate in platform automation initiatives.
  • Ensure compliance with internal and regulatory security standards.


Required Skills & Experience:
  • Minimum 15 years of overall IT experience with at least 5–7 years in data platform administration.
  • Strong hands-on experience in:
    • On-prem Kubernetes clusters (in-house distributions)
    • Azure Kubernetes Service (AKS)
    • Apache Spark cluster administration
    • Apache Ranger for data governance and access control
    • Apache KafkaApache AirflowTrinoIcebergDatahub
    • Azure DevOps (ADO) – pipelines, repos, artifacts
  • Proven experience with CI/CD for data platforms and infrastructure automation.
  • Strong Linux administration and scripting skills (Bash, Python preferred).
  • Deep understanding of networking, container orchestration, and cloud infrastructure (Azure preferred).
  • Experience in implementing monitoring and alerting systems for distributed environments.


Nice to Have:
  • Experience in highly regulated industries such as banking or financial services.
  • Familiarity with data lakehouse architectures.
  • Certifications in AzureKubernetes, or Big Data technologies.
When you apply, you voluntarily consent to the disclosure, collection and use of your personal data for employment/recruitment and related purposes in accordance with the Tech Aalto Privacy Policy, a copy of which is published at Tech Aalto's website )

Confidentiality is assured, and only shortlisted candidates will be notified for interviews.
  • Data platform administration-( ) years
    • On-prem Kubernetes clusters (in-house distributions)-( ) years
    • Azure Kubernetes Service (AKS)- ( ) years
    • Apache Spark cluster administration-( ) years
    • Apache Ranger for data governance and access control-( ) years
    • Apache KafkaApache AirflowTrinoIcebergDatahub-( ) years
    • Azure DevOps (ADO) – pipelines, repos, artifacts-( ) years
  • CI/CD for data platforms and infrastructure automation-( ) years
  • Strong Linux administration and scripting skills (Bash, Python)- ( ) years
  • Networking, container orchestration, and cloud infrastructure (Azure preferred)- ( ) years
  • Experience in implementing monitoring and alerting systems for distributed environments-( ) years


Nice to Have:
  • Experience in highly regulated industries such as banking or financial services.
  • Familiarity with data lakehouse architectures.
  • Certifications in AzureKubernetes, or Big Data technologies.


  • Singapore Airwallex Pty Ltd. Full time

    About Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...


  • Singapore Ensign InfoSecurity Full time

    Ensign is hiring ! Reporting to the Director of Platforms and Data Engineering, the Senior Platform and Data Engineer will work closely with Data Scientists, Threat Researchers/Analysts and Infrastructure Engineers to develop and manage high-performance analytics solutions. The incumbent will be accountable for the design, development, deployment and...


  • Singapore AIRWALLEX (SINGAPORE) PTE. LTD. Full time

    Senior Data Platform Engineer Hiring Location: Singapore (or Shanghai)Airwallex is the leading financial technology platform for modern businesses growing beyond borders. With one of the world's most powerful payments and banking infrastructures, our technology empowers businesses of all sizes to accept payments, move money globally, and simplify their...


  • Singapore Airwallex Full time $120,000 - $180,000 per year

    About AirwallexAirwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...


  • Singapore Airwallex Full time

    Airwallex is the leading financial technology platform for modern businesses growing beyond borders. With one of the world’s most powerful payments and banking infrastructure, our technology empowers businesses of all sizes to accept payments, move money globally, and simplify their financial operations, all in one single platform. Established in 2015 in...


  • Singapore Airwallex Full time $120,000 - $180,000 per year

    About AirwallexAirwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...


  • Singapore Equinix Full time

    **Senior Platform Engineer - Data & AI**: - JR-151601 - Hybrid - Singapore - Information Technology - Full time Who are we? Equinix is the world’s digital infrastructure company®, operating over 260 data centers across the globe. Digital leaders harness Equinix's trusted platform to bring together and interconnect foundational infrastructure at...


  • Singapore NodeFlair Full time

    **Job Summary**: **Job Type** **Seniority** **Years of Experience** Information not provided As an Entry Level to Mid Level Data Platform Engineer, you will be responsible for designing, implementing, and maintaining the Denodo Data Virtualization Platform. You will work closely with the project team to ensure seamless integration with other IT...


  • Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...


  • Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$7,000 - S$8,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake Oracle Shell Script Shell Java MSSQL Linux Python **COMPANY DESCRIPTION** Beyondsoft International (Singapore) Pte. Ltd. was set up in 2007 and established as the regional headquarters for the Southeast...