Data Platform Engineer

2 weeks ago


Singapore SKANDA TECHNOLOGIES PTE. LTD. Full time

**Responsibilities**:
Admin role: On-premises Kubernetes (inhouse Kubernetes Package) + Azure Kubernetes + Spark Cluster + ADO CICD-Apache Ranger, Spark, Kafka, Datahub, Airflow, Trino, Iceberg, Azure DevOps (CI/CD)& Kubernetes

**Scope**:

- Work with Client’s core platform team on installing inhouse packed on-premises Kubernetes.
- Configure Azure Kubernetes on cloud platform.
- Deploy Apache Spark, Apache Ranger and Apache Kafka on Kubernetes.
- Azure DevOps (ADO)/ recommended tool for deployment automation
- Data Storage are divided on Hot and Cold logical partition in GDP. Integrate ADLS G2 with the Hot and Cold storage via S3 Protocol.
- Integration with the bank’s Central Observability Platform (COP).
- Grafana-based monitoring dashboards for Spark jobs and K8s pods.
- Implementing data encryption at rest using TDE via SCB CaaS (Cryptography as a Service).
- **On-premises Kubernetes (Client’s inhouse Kubernetes Package) + Azure Kubernetes + Spark Cluster + ADO CICD-Apache Ranger, Spark, Kafka, Datahub, Airflow, Trino, Iceberg, Azure DevOps (CI/CD)& Kubernetes**
- Configuring on-wire encryption (TLS) for intra/inter-cluster communication.
- Enforcing RBAC (Role-Based Access Control) via Apache Ranger for Datahub, Spark, and Kafka.
- Working alongside the Client’s central security team for platform control assessments.
- During project execution, Client’s will come up with tools technology to transfer 5 PB data from one logical partition to another logical partition within existing Hadoop Platform.
- Migrating 1PB of data from Brownfield Azure HDI (ADLS G2) to Greenfield GDP AKS (ADLS G2).
- Implementing a backup & disaster recovery strategy for ADLS and Isilon.
- Tokenization of personal data using Protegrity.


  • Azure Data engineer

    4 days ago


    Singapore NTT Data Singapore Full time

    Job Responsibilities: Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...


  • Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full time $90,000 - $120,000 per year

    Note: Only Singapore Citizens will be considered.SummaryThe role provides operational support for data platforms , working with product teams, vendors, and end-users to design, deploy, and integrate solutions. Responsibilities include ensuring compliance with IT security policies, establishing monitoring processes, onboarding projects for BI needs (data...


  • Singapore Airwallex Full time

    About Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...


  • Singapore Airwallex Pty Ltd. Full time

    About Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...

  • Azure Data engineer

    7 days ago


    Singapore NTT Data Singapore Full time $60,000 - $180,000 per year

    Job Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...


  • Singapore International Baccalaureate Full time

    Join to apply for the Data Platform Engineer role at International Baccalaureate The Data Platform Engineer will be responsible for the design, build, maintenance, security and performance of the data analytics platform, serving both Digital Office stakeholders and lines of business. The work will range from larger technology delivery initiatives, working on...

  • Platform Engineer

    1 week ago


    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Join to apply for the Platform Engineer - Data Exploration Platform Management role at Centre for Strategic Infocomm Technologies (CSIT)1 month ago Be among the first 25 applicants Join to apply for the Platform Engineer - Data Exploration Platform Management role at Centre for Strategic Infocomm Technologies (CSIT)Get AI-powered advice on this job and more...


  • Singapore tendersglobal Full time

    tendersglobal.net JOB DESCRIPTION The Data Platform Engineer will be responsible for the design, build, maintenance, security and performance of the data analytics platform, serving both Digital Office stakeholders and lines of business. The work will range from larger technology delivery initiatives, working on a shared Digital Office Data Analytics product...


  • Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    **SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...


  • Singapore Ensign InfoSecurity Full time

    Reporting to Head, Platforms and Data Engineering, the Platforms and Data Engineer will work closely with Data Scientists, Threat/Malware Researchers, Project Managers and Infrastructure Engineers to develop and manage high-performance analytics solutions. The incumbent will be accountable for the design, development, deployment and maintenance of AI...