Data Platform Engineer
5 days ago
**Job Summary**:
**Key Responsibilities**:
- Administer and maintain **on-prem Kubernetes environments**using **in-house Kubernetes packages**, as well as **Azure Kubernetes Service (AKS)**clusters.
- Provision, configure, monitor, and manage **Apache Spark clusters**for large-scale data processing.
- Implement and support **CI/CD pipelines**using **Azure DevOps (ADO)**for data platform components and infrastructure.
- Ensure secure and governed data access using **Apache Ranger**and other security tools.
- Support and manage **distributed data systems**such as **Kafka, Trino, Airflow, Iceberg**, and **Datahub**.
- Monitor system health, identify performance bottlenecks, and perform root cause analysis for infrastructure and platform issues.
- Collaborate with DevOps, Data Engineering, and Cloud teams to optimize the scalability, performance, and resilience of the platform.
- Maintain infrastructure as code (IaC) practices and participate in platform automation initiatives.
- Ensure compliance with internal and regulatory security standards.
**Required Skills & Experience**:
- Minimum **15 years**of overall IT experience with at least **5-7 years in data platform administration**.
- Strong hands-on experience in:
- **On-prem Kubernetes clusters**(in-house distributions)
- **Azure Kubernetes Service (AKS)**:
- **Apache Spark**cluster administration
- **Apache Ranger**for data governance and access control
- **Apache Kafka**, **Apache Airflow**, **Trino**, **Iceberg**, **Datahub**:
- **Azure DevOps (ADO)**- pipelines, repos, artifacts
- Proven experience with **CI/CD for data platforms**and **infrastructure automation**.
- Strong Linux administration and scripting skills (Bash, Python preferred).
- Deep understanding of **networking, container orchestration, and cloud infrastructure**(Azure preferred).
- Experience in implementing **monitoring and alerting**systems for distributed environments.
**Nice to Have**:
- Experience in highly regulated industries such as **banking or financial services**.
- Familiarity with **data lakehouse architectures**.
- Certifications in **Azure**, **Kubernetes**, or **Big Data technologies**.
-
Platform and Data Engineer
1 week ago
Singapore Ensign InfoSecurity Full timeEnsign is hiring ! Reporting to Head, Platforms and Data Engineering, the Platforms and Data Engineer will work closely with Data Scientists, Threat/Malware Researchers, Project Managers and Infrastructure Engineers to develop and manage high-performance analytics solutions. The incumbent will be accountable for the design, development, deployment and...
-
Azure Data engineer
7 days ago
Singapore NTT Data Singapore Full time $80,000 - $120,000 per yearJob Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations...
-
Data Platform Engineer
1 week ago
Singapore International Baccalaureate Full timeJoin to apply for the Data Platform Engineer role at International Baccalaureate The Data Platform Engineer will be responsible for the design, build, maintenance, security and performance of the data analytics platform, serving both Digital Office stakeholders and lines of business. The work will range from larger technology delivery initiatives, working on...
-
Data Platform Engineer
5 days ago
Singapore TENTEN PARTNERS PTE. LTD Full timeWe are partnering with a well-established financial institution who is seeking a highly skilled Data Platform Engineer (SRE) to join their Technology team. This role is critical in ensuring the reliability, scalability, and performance of enterprise data platforms that power investment management operations. What You'll Do Drive Site Reliability Engineering...
-
Data Platform Engineer
1 week ago
Singapore tendersglobal Full timetendersglobal.net JOB DESCRIPTION The Data Platform Engineer will be responsible for the design, build, maintenance, security and performance of the data analytics platform, serving both Digital Office stakeholders and lines of business. The work will range from larger technology delivery initiatives, working on a shared Digital Office Data Analytics product...
-
Big Data Platform Engineer
6 days ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time**SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...
-
Data Platform Engineer
8 hours ago
Singapore INTERNATIONAL BACCALAUREATE ORGANIZATION (Singapore Branch) Full timeShort Description The Data Platform Engineer will be responsible for the design, build, maintenance, security and performance of the data analytics platform, serving both Digital Office stakeholders and lines of business. The work will range from larger technology delivery initiatives, working on a shared Digital Office Data Analytics product backlog,...
-
Principal Engineer, Data Platforms
3 days ago
Singapore DSTA - Defence Science & Technology Agency Full time**OVERVIEW**: - The Enterprise Digital Services Programme Centre works at the forefront of digitalisation of MINDEF and the SAF. We are looking for motivated engineers to join the Enterprise Digital Services Programme Centre. You will be joining a team of engineers who are excited about harnessing data and technology to to implement and manage data...
-
Data Platform Engineer II
5 days ago
Singapore AIRWALLEX (SINGAPORE) PTE. LTD. Full timeAirwallex is the leading financial technology platform for modern businesses growing beyond borders. With one of the world's most powerful payments and banking infrastructures, our technology empowers businesses of all sizes to accept payments, move money globally, and simplify their financial operations, all in one single platform. Established in 2015 in...
-
Data Engineer
1 week ago
Singapore Bayer Full time**Data Engineer APAC** The Data Engineer (RAD Platform) is responsible to design and deliver comprehensive technical data platforms providing reliable and consistent data to Bayer internal and external radiology customers. He/She will also focus on Deliver the ‘Deep Customer Knowledge’ platform to the business stakeholders including visualization of...