Big Data Platform Engineer

6 days ago

Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

**SINGAPORE, SINGAPORE /**

**SOFTWARE ENGINEERING - DATA PLATFORMS /**

**FULL-TIME**
- Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion to processing to persistence. You are encouraged to suggest the best way to deliver value and the technologies used. Join the awesome CSIT family and use cutting-edge technologies to protect the nation.

**Responsibilities**
- Implement and maintain real-time high-volume data processing, querying and persistence solutions using Big Data technologies
- Implement highly available, resilient, scalable and sustainable Big Data platforms
- Administer (configuration, backup and recovery) Big Data platform services running across multiple clusters
- Deploy and manage the cluster efficiently using DevOps and automation tools
- Build performance and health monitoring tools to ensure optimal system performance and availability
- Work closely with different teams to ensure smooth onboarding and operations of the Big Data platform
- Conduct resource planning and scaling exercises to support increasing workload
- Conduct research and evaluations of new technologies
- Innovate and improve the current system

**Requirements (Minimum Qualifications)**
- Bachelor’s degree in Computer Engineering, Computer Science or equivalent experience
- Able to communicate clearly
- Positive attitude and excellent teamwork
- Passionate about big data technologies
- Love for open source technologies

**Nice-to-haves**
- Experience in managing physical and virtual infrastructures
- Experience with cluster management and DevOps tools (e.g. Ansible, Kubernetes)
- Experience working in an agile and innovative environment

**Why join us?**
- The work is purposeful and meaningful
- You will work with the best engineers
- We work with modern technologies and tech stacks
- We have excellent engineering culture and work-life balance
- We aspire to engineering and operational excellence
- We empower to innovate
- We grow together as a family
- As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered._

  • Big Data Platform SRE Engineer

    4 days ago

    Singapore-CapitaSky Tencent Full time $100,000 - $150,000 per year

    Business UnitTechnology Engineering Group (TEG) is responsible for supporting the company and its business groups on technology and operational platforms, as well as the construction and operation of R&D management and data centers, TEG provides users with a full range of customer services. As the operator of the largest networking, devices, and data center...

  • Big Data Engineer, Web3 Data Platform

    2 weeks ago

    Singapore NEAR Full time

    OKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa. About OKX At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto...

  • Big Data Engineer, Web3 Data Platform

    2 weeks ago

    Singapore OKX Full time $120,000 - $180,000 per year

    OKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visaAbout OKX At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto...

  • Big Data Platform Architect

    1 day ago

    Singapore BigTapp Full time

    **Job Title**: Big Data Platform Architect **Job Location**: Singapore **Job Purpose** The Big Data Platform Architect is responsible for the technical design and implementation of big data platform, systems integration, processes and governance to operationalize the big data platform. The Big Data Platform Architect is required to work closely with...

  • Big Data Engineer

    4 days ago

    Singapore SAKSOFT PTE LIMITED Full time

    Experience: 9+ Years Role: Big Data Engineer Skills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting(Good to have). Design...

  • Big Data Engineer

    1 week ago

    Singapore ALMR CONSULTING PTE. LTD. Full time $100,000 - $150,000 per year

    Job Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.Key...

  • Big Data Engineer

    1 week ago

    Singapore ALMR Consulting Pte Ltd Full time $150,000 - $200,000 per year

    Roles & ResponsibilitiesJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting...

  • Big Data Platform Development

    6 days ago

    Singapore INOVAS TECH PTE. LTD. Full time

    **Employer briefing**: Our client is a leading interactive entertainment company revolutionizing the gaming industry. With a strong focus on innovation and exceptional game development, our client creates immersive experiences that captivate players worldwide. As the mastermind behind popular titles like "Genshin Impact," our client pushes the boundaries of...

  • Lead Big Data Platforms, Automation

    2 weeks ago

    Singapore Micron Full time

    **Our vision is to transform how the world uses information to enrich life for all.** Join an inclusive team passionate about one thing: using their expertise in the relentless pursuit of innovation for customers and partners. The solutions we build help make everything from virtual reality experiences to breakthroughs in neural networks possible. We do it...

  • Big Data Test Engineer

    7 days ago

    Singapore Patsnap Full time $80,000 - $120,000 per year

    About PatSnap Patsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable...