Data Platform Engineer

1 week ago


Singapore SKANDA TECHNOLOGIES PTE. LTD. Full time

**Responsibilities**:
Admin role: On-premises Kubernetes (inhouse Kubernetes Package) + Azure Kubernetes + Spark Cluster + ADO CICD-Apache Ranger, Spark, Kafka, Datahub, Airflow, Trino, Iceberg, Azure DevOps (CI/CD)& Kubernetes

**Scope**:

- Work with Client’s core platform team on installing inhouse packed on-premises Kubernetes.
- Configure Azure Kubernetes on cloud platform.
- Deploy Apache Spark, Apache Ranger and Apache Kafka on Kubernetes.
- Azure DevOps (ADO)/ recommended tool for deployment automation
- Data Storage are divided on Hot and Cold logical partition in GDP. Integrate ADLS G2 with the Hot and Cold storage via S3 Protocol.
- Integration with the bank’s Central Observability Platform (COP).
- Grafana-based monitoring dashboards for Spark jobs and K8s pods.
- Implementing data encryption at rest using TDE via SCB CaaS (Cryptography as a Service).
- **On-premises Kubernetes (Client’s inhouse Kubernetes Package) + Azure Kubernetes + Spark Cluster + ADO CICD-Apache Ranger, Spark, Kafka, Datahub, Airflow, Trino, Iceberg, Azure DevOps (CI/CD)& Kubernetes**
- Configuring on-wire encryption (TLS) for intra/inter-cluster communication.
- Enforcing RBAC (Role-Based Access Control) via Apache Ranger for Datahub, Spark, and Kafka.
- Working alongside the Client’s central security team for platform control assessments.
- During project execution, Client’s will come up with tools technology to transfer 5 PB data from one logical partition to another logical partition within existing Hadoop Platform.
- Migrating 1PB of data from Brownfield Azure HDI (ADLS G2) to Greenfield GDP AKS (ADLS G2).
- Implementing a backup & disaster recovery strategy for ADLS and Isilon.
- Tokenization of personal data using Protegrity.



  • Singapore Airwallex Full time

    **About Airwallex** Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide - including Brex, Rippling, Navan, Qantas, SHEIN and many more - with fully integrated solutions to manage everything from business...


  • Singapore Airwallex Full time

    About Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...


  • Singapore Airwallex Full time $150,000 - $200,000 per year

    About AirwallexAirwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...


  • Singapore beBeeData Full time $100,000 - $150,000

    Develop a strong understanding of data engineering principles and design scalable data pipelines to drive business growth through data-driven insights.As a key member of our digital transformation project, you will work on large-scale projects and collaborate with cross-functional teams to achieve business objectives.Key responsibilities include:Designing...

  • Data Engineer

    2 days ago


    Singapore Housing and Development Board Full time

    **About Us!** The mission of Housing & Development Board (HDB) is to provide affordable, quality housing and a great living environment where communities thrive. To achieve its mission, HDB aims to be data-driven to the core and adopt evidence-based decision making in developing better housing policies service, improving service delivery and optimising...


  • Singapore Grab Full time

    **Job Description**: **Life at Grab** At Grab, every Grabber is guided by The Grab Way, which spells out our mission, how we believe we can achieve it, and our operating principles - the 4Hs: Heart, Hunger, Honour and Humility. These principles guide and help us make decisions as we work to create economic empowerment for the people of Southeast...

  • Azure Data engineer

    2 weeks ago


    Singapore NTT Data Singapore Full time

    Job Responsibilities: Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...


  • Singapore beBeePlatform Full time $120,000 - $180,000

    **Job Description:**We are seeking a highly motivated and experienced Platform Engineer to design, build, and maintain scalable data platforms in a hybrid cloud environment.The ideal candidate will have strong collaboration skills, with the ability to work effectively with database, network, infrastructure, and business teams.Responsibilities include:Data &...


  • Singapore TECH AALTO PTE. LTD. Full time

    **Job Summary**: **Key Responsibilities**: - Administer and maintain **on-prem Kubernetes environments**using **in-house Kubernetes packages**, as well as **Azure Kubernetes Service (AKS)**clusters. - Provision, configure, monitor, and manage **Apache Spark clusters**for large-scale data processing. - Implement and support **CI/CD pipelines**using **Azure...

  • Data Engineer

    1 week ago


    Singapore NTT DATA, Inc. Full time

    Join to apply for the Data Engineer role at NTT DATA, Inc. . Overview As part of our data-driven transformation initiatives, we are looking for a motivated Associate Data Engineer to join our team. This role is ideal for early-career professionals who are passionate about building scalable data pipelines, integrating diverse data sources, and enabling...