Big Data Platform Engineer

2 days ago

Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

Join to apply for the Big Data Platform Engineer role at Centre for Strategic Infocomm Technologies (CSIT)

1 week ago Be among the first 25 applicants

Join to apply for the Big Data Platform Engineer role at Centre for Strategic Infocomm Technologies (CSIT)

Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion to processing to persistence. You are encouraged to suggest the best way to deliver value and the technologies used. Join the awesome CSIT family and use cutting-edge technologies to protect the nation.
Responsibilities

  • Implement and maintain real-time high-volume data processing, querying and persistence solutions using Big Data technologies
  • Implement highly available, resilient, scalable and sustainable Big Data platforms
  • Administer (configuration, backup and recovery) Big Data platform services running across multiple clusters
  • Deploy and manage the cluster efficiently using DevOps and automation tools
  • Build performance and health monitoring tools to ensure optimal system performance and availability
  • Work closely with different teams to ensure smooth onboarding and operations of the Big Data platform
  • Conduct resource planning and scaling exercises to support increasing workload
  • Conduct research and evaluations of new technologies
  • Innovate and improve the current system
Requirements (Minimum Qualifications)
  • Bachelor’s degree in Computer Engineering, Computer Science or equivalent experience
  • Able to communicate clearly
  • Positive attitude and excellent teamwork
  • Passionate about big data technologies
  • Love for open source technologies
Nice-to-haves
  • Experience in managing physical and virtual infrastructures
  • Experience with cluster management and DevOps tools (e.g. Ansible, Kubernetes)
  • Experience working with application or product teams
  • Experience working in an agile and innovative environment
Why join us?
  • The work is purposeful and meaningful
  • You will work with the best engineers
  • We work with modern technologies and tech stacks
  • We have excellent engineering culture and work-life balance
  • We aspire to engineering and operational excellence
  • We empower to innovate
  • We grow together as a family
As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.

Seniority level

  • Seniority level

    Entry level

Employment type

  • Employment type

    Full-time

Job function

  • Job function

    Engineering and Information Technology

  • Industries

    IT Services and IT Consulting

Referrals increase your chances of interviewing at Centre for Strategic Infocomm Technologies (CSIT) by 2x

Get notified about new Big Data Developer jobs in Singapore, Singapore .

Project Intern, Digital Innovations & Solutions (Full Stack Developer)

Web Frontend Engineer(Work Location: Remote in Taiwan)

Software Engineer - Java, Kotlin, Spring boot

Frontend Software Engineer (For E-Trading Platform)

Downtown Core, Central Singapore Community Development Council, Singapore 1 week ago

Queenstown, Central Singapore Community Development Council, Singapore 5 months ago

South East Community Development Council, Singapore 1 week ago

Software Engineer SG - Internship 2025 (3-6 months)

Software Engineer - Java, Kotlin, Spring boot

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

  • Big Data Platform Engineer

    2 weeks ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...

  • Platform Engineer – Big Data

    4 days ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesWe are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive. Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets. Maintain and fine-tune...

  • Platform Engineer – Big Data

    4 days ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time $104,000 - $130,878 per year

    We are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN)...

  • Platform Engineer – Big Data

    5 days ago

    Singapore UNISON CONSULTING PTE. LTD. Full time

    Roles & Responsibilities•Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive.•Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.•Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.•Build and...

  • Engineering Manager

    2 weeks ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    As an Engineering Manager of Big Data Platform, you lead engineering teams to deliver Big Data platforms for running mission-critical workflows. You set the technical direction, architect, lead and manage the development Big Data Platforms. You push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...

  • Platform Engineer – Big Data

    4 days ago

    Singapore UARROW PTE. LTD. Full time $104,000 - $130,878 per year

    Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.Build and support Hive-based data warehouses for...

  • Senior Big Data Platform Engineer

    2 weeks ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...

  • Big Data Platform Engineer

    1 week ago

    Singapore COGNIZANT TECHNOLOGY SOLUTIONS ASIA PACIFIC PTE. LTD. Full time

    Roles & Responsibilities Role & Responsibilities Operating Global Data Platform components (VM Servers, Kubernetes, Kafka) and applications (Apache stack, Collibra, Dataiku and similar). Implement automation of infrastructure, security components, and Continuous Integration & Continuous Delivery for optimal execution of data pipelines (ELT/ETL). ...

  • Big Data Platform Engineer

    7 days ago

    Singapore COGNIZANT TECHNOLOGY SOLUTIONS ASIA PACIFIC PTE. LTD. Full time

    Roles & ResponsibilitiesRole & ResponsibilitiesOperating Global Data Platform components (VM Servers, Kubernetes, Kafka) and applications (Apache stack, Collibra, Dataiku and similar). Implement automation of infrastructure, security components, and Continuous Integration & Continuous Delivery for optimal execution of data pipelines (ELT/ETL). Develop...

  • Staff Platform Engineer

    13 minutes ago

    Singapore Centre for Strategic Infocomm Technologies Full time

    CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of operations, including but not limited to Counter-terrorism and Computer NetworkDefence. We are looking for talented Senior Big Data Platform Staff Engineer. Join the awesome CSIT family and use cutting-edge technologies to protect the...