Senior Big Data Platform Engineer

2 weeks ago

Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion to processing to persistence. You are encouraged to suggest the best way to deliver value and the technologies used. Join the awesome CSIT family and use cutting-edge technologies to protect the nation.

**Responsibilities**:
- Design, implement and maintain real-time high-volume data processing, querying and persistence solutions using Big Data technologies
- Design and implement highly available, resilient, scalable and sustainable Big Data platforms
- Administer (configuration, backup and recovery) Big Data platform services running across multiple clusters
- Deploy and manage the cluster efficiently using DevOps and automation tools
- Build performance and health monitoring tools to ensure optimal system performance and availability
- Work closely with different teams to ensure smooth onboarding and operations of the Big Data platform
- Conduct resource planning and scaling exercises to support increasing workload
- Conduct research and evaluations of new technologies
- Innovate and improve the current system

**Requirements (Minimum Qualifications)**:
- Bachelor’s degree in Computer Engineering, Computer Science or equivalent experience
- Able to communicate clearly
- Positive attitude and excellent teamwork
- Passionate about big data technologies
- Love for open source technologies
- **Additional qualifications for senior position**:

- At least 5 years of experience in big data domain
- Deep expertise in big data platform
- Experience in leading engineering teams
- Technical leadership and mentoring/coaching experience

**Nice-to-haves**:
- Experience in distributed systems
- Experience in supporting search workloads in multi-terabytes and billions of records
- Experience in managing physical and virtual infrastructures
- Experience in using and managing Hadoop cluster services (Spark, Kafka, HBase, Hive, Hadoop, HDFS, Nifi, Kudu, Solr, ElasticSearch)
- Experience in troubleshooting and resolving issues of the Big Data stack, ranging from hardware, networking, OS to software
- Experience with cluster management and DevOps tools (e.g. Ansible, Kubernetes)
- Experience working in an agile and innovative environment

**Why join us?**:
- The work is purposeful and meaningful
- You will work with the best engineers
- We work with modern technologies and tech stacks
- We have excellent engineering culture and work-life balance
- We aspire to engineering and operational excellence
- We empower to innovate
- We grow together as a family
- As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered._

  • Big Data Platform Engineer

    2 weeks ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...

  • Engineering Manager

    2 weeks ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    As an Engineering Manager of Big Data Platform, you lead engineering teams to deliver Big Data platforms for running mission-critical workflows. You set the technical direction, architect, lead and manage the development Big Data Platforms. You push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...

  • Big Data Engineer, Data Platform

    3 days ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** ETL ClickHouse Metastore Analytics R Flume Presto Hive Spark kafka Flink SQL **Responsibilities** TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require...

  • Big Data Global Manager

    2 days ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$9,187 - S$18,375 / Monthly EST **Job Type** Permanent **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Strategy Analytics Java SQL Scala Python - What you will be doing: - We are looking for a Big Data Global Manager to join the team. As the Big Data Global Manager, you will provide big data power...

  • Senior Engineer

    4 days ago

    Singapore Reeracoen Singapore Pte Ltd Full time

    Our client is a dynamic technology consulting company specializing in digital transformation and innovative solutions. They are currently looking for a Senior Engineer (Big Data) to join their tech engineering team. - 【 What you will be doing 】- Responsible for designing, creating, and managing large-scale data processing systems. - Ensure that systems...

  • Big Data Platform Engineer

    1 day ago

    Singapore Helius Technologies Full time

    3 days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Helius Technologies Job Type : 1 year renewable contract Client : Banking Sector Key Skills: Maintenance of VM servers Kafka Streaming, Spark Day-to-day maintenance of databases and load processes, CI/CD pipelines,...

  • Senior Platform and Data Engineer

    19 hours ago

    Singapore Ensign InfoSecurity Full time

    Ensign is hiring ! Reporting to the Director of Platforms and Data Engineering, the Senior Platform and Data Engineer will work closely with Data Scientists, Threat Researchers/Analysts and Infrastructure Engineers to develop and manage high-performance analytics solutions. The incumbent will be accountable for the design, development, deployment and...

  • Big Data Development Engineer

    4 days ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 1 year **Tech Stacks** ClickHouse Analytics Java Spark Scala Hadoop **Responsibilities** **About TikTok** TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok...

  • Big Data Platform Expert

    1 day ago

    Singapore beBee Careers Full time

    Job Description:OverviewWe are seeking a highly skilled Big Data Platform Expert to oversee the day-to-day operations of our big data platform, ensuring high availability, reliability, and performance.ResponsibilitiesProactively monitor big data platform services, components, and clusters to identify potential issues.Take corrective actions as needed to...

  • Senior Big Data Engineer

    20 hours ago

    Singapore Binance Full time

    Binance is a leading global blockchain ecosystem behind the world’s largest cryptocurrency exchange by trading volume and registered users. We are trusted by over 230 million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset products. Binance...