Senior Data Platform Engineer
2 days ago
We are seeking an experienced Senior Data Platform Engineer with over 15 years of expertise in managing and administering complex data and compute infrastructure across on-premises and cloud environments. The ideal candidate will have deep hands-on experience with Kubernetes (on-prem & Azure), Spark Clusters, and CI/CD pipelines using Azure DevOps, with a strong background in modern data platform tools including Apache Ranger, Kafka, Airflow, Trino, Iceberg, and Datahub.
Key Responsibilities:
- Administer and maintain on-prem Kubernetes environments using in-house Kubernetes packages, as well as Azure Kubernetes Service (AKS) clusters.
- Provision, configure, monitor, and manage Apache Spark clusters for large-scale data processing.
- Implement and support CI/CD pipelines using Azure DevOps (ADO) for data platform components and infrastructure.
- Ensure secure and governed data access using Apache Ranger and other security tools.
- Support and manage distributed data systems such as Kafka, Trino, Airflow, Iceberg, and Datahub.
- Monitor system health, identify performance bottlenecks, and perform root cause analysis for infrastructure and platform issues.
- Collaborate with DevOps, Data Engineering, and Cloud teams to optimize the scalability, performance, and resilience of the platform.
- Maintain infrastructure as code (IaC) practices and participate in platform automation initiatives.
- Ensure compliance with internal and regulatory security standards.
Required Skills & Experience:
- Minimum 15 years of overall IT experience with at least 5–7 years in data platform administration.
- Strong hands-on experience in:
- On-prem Kubernetes clusters (in-house distributions)
- Azure Kubernetes Service (AKS)
- Apache Spark cluster administration
- Apache Ranger for data governance and access control
- Apache Kafka, Apache Airflow, Trino, Iceberg, Datahub
- Azure DevOps (ADO) – pipelines, repos, artifacts
- Proven experience with CI/CD for data platforms and infrastructure automation.
- Strong Linux administration and scripting skills (Bash, Python preferred).
- Deep understanding of networking, container orchestration, and cloud infrastructure (Azure preferred).
- Experience in implementing monitoring and alerting systems for distributed environments.
Nice to Have:
- Experience in highly regulated industries such as banking or financial services.
- Familiarity with data lakehouse architectures.
- Certifications in Azure, Kubernetes, or Big Data technologies.
Confidentiality is assured, and only shortlisted candidates will be notified for interviews.
- Data platform administration-( ) years
- On-prem Kubernetes clusters (in-house distributions)-( ) years
- Azure Kubernetes Service (AKS)- ( ) years
- Apache Spark cluster administration-( ) years
- Apache Ranger for data governance and access control-( ) years
- Apache Kafka, Apache Airflow, Trino, Iceberg, Datahub-( ) years
- Azure DevOps (ADO) – pipelines, repos, artifacts-( ) years
- CI/CD for data platforms and infrastructure automation-( ) years
- Strong Linux administration and scripting skills (Bash, Python)- ( ) years
- Networking, container orchestration, and cloud infrastructure (Azure preferred)- ( ) years
- Experience in implementing monitoring and alerting systems for distributed environments-( ) years
Nice to Have:
- Experience in highly regulated industries such as banking or financial services.
- Familiarity with data lakehouse architectures.
- Certifications in Azure, Kubernetes, or Big Data technologies.
-
Singapore Airwallex Pty Ltd. Full timeAbout Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...
-
Senior Platform and Data Engineer
5 hours ago
Singapore Ensign InfoSecurity Full timeEnsign is hiring ! Reporting to the Director of Platforms and Data Engineering, the Senior Platform and Data Engineer will work closely with Data Scientists, Threat Researchers/Analysts and Infrastructure Engineers to develop and manage high-performance analytics solutions. The incumbent will be accountable for the design, development, deployment and...
-
Senior Data Platform Engineer
2 weeks ago
Singapore AIRWALLEX (SINGAPORE) PTE. LTD. Full timeSenior Data Platform Engineer Hiring Location: Singapore (or Shanghai)Airwallex is the leading financial technology platform for modern businesses growing beyond borders. With one of the world's most powerful payments and banking infrastructures, our technology empowers businesses of all sizes to accept payments, move money globally, and simplify their...
-
Data Platform Engineer, Growth Data Platform
2 days ago
Singapore Airwallex Full time $120,000 - $180,000 per yearAbout AirwallexAirwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...
-
Senior Data Platform Engineer
2 weeks ago
Singapore Airwallex Full timeAirwallex is the leading financial technology platform for modern businesses growing beyond borders. With one of the world’s most powerful payments and banking infrastructure, our technology empowers businesses of all sizes to accept payments, move money globally, and simplify their financial operations, all in one single platform. Established in 2015 in...
-
Senior Data Platform Engineer
2 days ago
Singapore Airwallex Full time $120,000 - $180,000 per yearAbout AirwallexAirwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...
-
Senior Platform Engineer
4 days ago
Singapore Equinix Full time**Senior Platform Engineer - Data & AI**: - JR-151601 - Hybrid - Singapore - Information Technology - Full time Who are we? Equinix is the world’s digital infrastructure company®, operating over 260 data centers across the globe. Digital leaders harness Equinix's trusted platform to bring together and interconnect foundational infrastructure at...
-
Data Platform Engineer
5 hours ago
Singapore NodeFlair Full time**Job Summary**: **Job Type** **Seniority** **Years of Experience** Information not provided As an Entry Level to Mid Level Data Platform Engineer, you will be responsible for designing, implementing, and maintaining the Denodo Data Virtualization Platform. You will work closely with the project team to ensure seamless integration with other IT...
-
Senior Big Data Platform Engineer
2 weeks ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full timeData processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...
-
Data Platform Engineer
2 days ago
Singapore NodeFlair Full time**Job Summary**: **Salary** S$7,000 - S$8,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake Oracle Shell Script Shell Java MSSQL Linux Python **COMPANY DESCRIPTION** Beyondsoft International (Singapore) Pte. Ltd. was set up in 2007 and established as the regional headquarters for the Southeast...