Platform Engineer – Big Data

4 days ago

Singapore RISKDATA CONSULTING PTE. LTD. Full time $104,000 - $130,878 per year

We are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;

Responsibilities

  • Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive.
  • Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.
  • Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.
  • Build and support Hive-based data warehouses for analytics, including schema design, partitioning, and performance optimization.
  • Optimize Spark jobs for batch and streaming use cases (memory management, shuffle tuning, query optimization).
  • Implement data security and governance policies (Kerberos, Ranger, Atlas) to ensure compliance and controlled access.
  • Collaborate with data engineers, architects, and analysts to deliver robust and efficient platform capabilities.
  • Drive automation in cluster operations, deployments, and monitoring using scripting and DevOps tools.

Skills

  • Experience in data engineering or platform engineering with strong focus on big data ecosystems.
  • Deep expertise in Hadoop (HDFS, YARN) cluster management and optimization.
  • Strong hands-on experience in Spark (batch + streaming) and Hive data modeling.
  • Experience in performance tuning, query optimization, and cluster troubleshooting.
  • Familiarity with distributed system internals, resource management, and fault tolerance.
  • Knowledge of cloud big data platforms (AWS EMR, Azure HDInsight, GCP Dataproc) is a plus.
  • Exposure to automation frameworks (Ansible, Terraform, Airflow, CI/CD pipelines) is preferred.

  • Big Data Platform Engineer

    5 days ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    **SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...

  • Platform Engineer – Big Data

    4 days ago

    Singapore UARROW PTE. LTD. Full time $120,000 - $180,000 per year

    Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.Build and support Hive-based data warehouses for...

  • Big Data Engineer, Data Platform

    1 week ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 1 year **Tech Stacks** ETL ClickHouse Metastore Analytics R Flume Presto Hive Spark kafka Flink SQL **Responsibilities** TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require...

  • Big Data Engineer, Web3 Data Platform

    3 days ago

    Singapore OKX Full time $120,000 - $180,000 per year

    OKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visaAbout OKX At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto...

  • Big Data Development Engineer

    2 weeks ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$11,250 - S$22,500 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 1 year **Tech Stacks** ClickHouse Analytics Java Spark Scala Hadoop **About Tiktok** TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices...

  • Big Data Development Engineer

    1 week ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$11,250 - S$22,500 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** ClickHouse Analytics Java Spark Scala Hadoop **Responsibilities** **About TikTok** TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok...

  • Big Data Engineer

    4 days ago

    Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full time

    Job Title: Big Data Engineer (Java, Spark, Hadoop)Location : Singapore Experience : 7- 12 years Employment Type : Full-Time Open to Citizens and SPR only | No Visa sponsorship available Job Summary We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep...

  • Big Data Engineer

    2 weeks ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$11,250 - S$22,500 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** ETL ClickHouse Presto Java Hive Spark Flink SQL Scala Hadoop Python **About Tiktok** TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok...

  • Big Data Engineer

    1 week ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 1 year **Tech Stacks** ETL ClickHouse Presto Java Hive Spark Flink SQL Scala Hadoop Python **Responsibilities **About TikTok** TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity...

  • Big Data Engineer

    1 day ago

    Singapore ALMR CONSULTING PTE. LTD. Full time $100,000 - $150,000 per year

    Job Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.Key...