Platform Engineer – Big Data

5 days ago

Singapore UNISON CONSULTING PTE. LTD. Full time
Roles & Responsibilities


•Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive.


•Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.


•Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.


•Build and support Hive-based data warehouses for analytics, including schema design, partitioning, and performance optimization.


•Optimize Spark jobs for batch and streaming use cases (memory management, shuffle tuning, query optimization).


•Implement data security and governance policies (Kerberos, Ranger, Atlas) to ensure compliance and controlled access.


•Collaborate with data engineers, architects, and analysts to deliver robust and efficient platform capabilities.


•Drive automation in cluster operations, deployments, and monitoring using scripting and DevOps tools.

Skills


•Experience in data engineering or platform engineering with strong focus on big data ecosystems.


•Deep expertise in Hadoop (HDFS, YARN) cluster management and optimization.


•Strong hands-on experience in Spark (batch + streaming) and Hive data modeling.


•Experience in performance tuning, query optimization, and cluster troubleshooting.


•Familiarity with distributed system internals, resource management, and fault tolerance.


•Knowledge of cloud big data platforms (AWS EMR, Azure HDInsight, GCP Dataproc) is a plus.


•Exposure to automation frameworks (Ansible, Terraform, Airflow, CI/CD pipelines) is preferred.

Tell employers what skills you have

Airflow
Tolerance
Azure
Big Data
Data Modeling
Pipelines
Hadoop
Architects
Scripting
Tuning
Data Engineering
EMR
Performance Tuning
GCP
Resource Management
Ansible

  • Big Data Platform Engineer

    2 weeks ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...

  • Big Data Platform Engineer

    2 days ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Join to apply for the Big Data Platform Engineer role at Centre for Strategic Infocomm Technologies (CSIT) 1 week ago Be among the first 25 applicants Join to apply for the Big Data Platform Engineer role at Centre for Strategic Infocomm Technologies (CSIT) Data processing is an essential part of national security in the modern world. As an engineer in...

  • Platform Engineer – Big Data

    5 days ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesWe are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive. Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets. Maintain and fine-tune...

  • Platform Engineer – Big Data

    4 days ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time $104,000 - $130,878 per year

    We are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN)...

  • Engineering Manager

    2 weeks ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    As an Engineering Manager of Big Data Platform, you lead engineering teams to deliver Big Data platforms for running mission-critical workflows. You set the technical direction, architect, lead and manage the development Big Data Platforms. You push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...

  • Platform Engineer – Big Data

    4 days ago

    Singapore UARROW PTE. LTD. Full time $104,000 - $130,878 per year

    Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.Build and support Hive-based data warehouses for...

  • Senior Big Data Platform Engineer

    2 weeks ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...

  • Big Data Platform Engineer

    2 weeks ago

    Singapore COGNIZANT TECHNOLOGY SOLUTIONS ASIA PACIFIC PTE. LTD. Full time

    Roles & Responsibilities Role & Responsibilities Operating Global Data Platform components (VM Servers, Kubernetes, Kafka) and applications (Apache stack, Collibra, Dataiku and similar). Implement automation of infrastructure, security components, and Continuous Integration & Continuous Delivery for optimal execution of data pipelines (ELT/ETL). ...

  • Big Data Platform Engineer

    7 days ago

    Singapore COGNIZANT TECHNOLOGY SOLUTIONS ASIA PACIFIC PTE. LTD. Full time

    Roles & ResponsibilitiesRole & ResponsibilitiesOperating Global Data Platform components (VM Servers, Kubernetes, Kafka) and applications (Apache stack, Collibra, Dataiku and similar). Implement automation of infrastructure, security components, and Continuous Integration & Continuous Delivery for optimal execution of data pipelines (ELT/ETL). Develop...

  • Staff Platform Engineer

    4 hours ago

    Singapore Centre for Strategic Infocomm Technologies Full time

    CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of operations, including but not limited to Counter-terrorism and Computer NetworkDefence. We are looking for talented Senior Big Data Platform Staff Engineer. Join the awesome CSIT family and use cutting-edge technologies to protect the...