Big Data Platform Engineer

3 days ago

Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

**SINGAPORE, SINGAPORE /**

**SOFTWARE ENGINEERING - DATA PLATFORMS /**

**FULL-TIME**
- Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion to processing to persistence. You are encouraged to suggest the best way to deliver value and the technologies used. Join the awesome CSIT family and use cutting-edge technologies to protect the nation.

**Responsibilities**
- Implement and maintain real-time high-volume data processing, querying and persistence solutions using Big Data technologies
- Implement highly available, resilient, scalable and sustainable Big Data platforms
- Administer (configuration, backup and recovery) Big Data platform services running across multiple clusters
- Deploy and manage the cluster efficiently using DevOps and automation tools
- Build performance and health monitoring tools to ensure optimal system performance and availability
- Work closely with different teams to ensure smooth onboarding and operations of the Big Data platform
- Conduct resource planning and scaling exercises to support increasing workload
- Conduct research and evaluations of new technologies
- Innovate and improve the current system

**Requirements (Minimum Qualifications)**
- Bachelor’s degree in Computer Engineering, Computer Science or equivalent experience
- Able to communicate clearly
- Positive attitude and excellent teamwork
- Passionate about big data technologies
- Love for open source technologies

**Nice-to-haves**
- Experience in managing physical and virtual infrastructures
- Experience with cluster management and DevOps tools (e.g. Ansible, Kubernetes)
- Experience working in an agile and innovative environment

**Why join us?**
- The work is purposeful and meaningful
- You will work with the best engineers
- We work with modern technologies and tech stacks
- We have excellent engineering culture and work-life balance
- We aspire to engineering and operational excellence
- We empower to innovate
- We grow together as a family
- As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered._

  • Platform Engineer – Big Data

    2 days ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time $104,000 - $130,878 per year

    We are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN)...

  • Platform Engineer – Big Data

    2 days ago

    Singapore UARROW PTE. LTD. Full time $120,000 - $180,000 per year

    Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.Build and support Hive-based data warehouses for...

  • Big Data Engineer, Data Platform

    1 week ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 1 year **Tech Stacks** ETL ClickHouse Metastore Analytics R Flume Presto Hive Spark kafka Flink SQL **Responsibilities** TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require...

  • Big Data Global Manager

    2 weeks ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$9,187 - S$18,375 / Monthly EST **Job Type** Permanent **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Strategy Analytics Java SQL Scala Python - What you will be doing: - We are looking for a Big Data Global Manager to join the team. As the Big Data Global Manager, you will provide big data power...

  • Big Data Engineer, Web3 Data Platform

    8 hours ago

    Singapore OKX Full time $120,000 - $180,000 per year

    OKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visaAbout OKX At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto...

  • Big Data Engineer

    1 day ago

    Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full time

    Job Title: Big Data Engineer (Java, Spark, Hadoop)Location : Singapore Experience : 7- 12 years Employment Type : Full-Time Open to Citizens and SPR only | No Visa sponsorship available Job Summary We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep...

  • Big Data Development Engineer

    2 weeks ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$11,250 - S$22,500 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 1 year **Tech Stacks** ClickHouse Analytics Java Spark Scala Hadoop **About Tiktok** TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices...

  • Big Data Development Engineer

    1 week ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$11,250 - S$22,500 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** ClickHouse Analytics Java Spark Scala Hadoop **Responsibilities** **About TikTok** TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok...

  • Big Data Engineer

    2 weeks ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$11,250 - S$22,500 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** ETL ClickHouse Presto Java Hive Spark Flink SQL Scala Hadoop Python **About Tiktok** TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok...

  • Big Data Engineer

    1 week ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 1 year **Tech Stacks** ETL ClickHouse Presto Java Hive Spark Flink SQL Scala Hadoop Python **Responsibilities **About TikTok** TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity...