Big Data Platform Engineer

5 days ago

Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion to processing to persistence. You are encouraged to suggest the best way to deliver value and the technologies used. Join the awesome CSIT family and use cutting-edge technologies to protect the nation.

**Responsibilities**
- Implement and maintain real-time high-volume data processing, querying and persistence solutions using Big Data technologies
- Implement highly available, resilient, scalable and sustainable Big Data platforms
- Administer (configuration, backup and recovery) Big Data platform services running across multiple clusters
- Deploy and manage the cluster efficiently using DevOps and automation tools
- Build performance and health monitoring tools to ensure optimal system performance and availability
- Work closely with different teams to ensure smooth onboarding and operations of the Big Data platform
- Conduct resource planning and scaling exercises to support increasing workload
- Conduct research and evaluations of new technologies
- Innovate and improve the current system

**Requirements (Minimum Qualifications)**
- Bachelor’s degree in Computer Engineering, Computer Science or equivalent experience
- Able to communicate clearly
- Positive attitude and excellent teamwork
- Passionate about big data technologies
- Love for open source technologies

**Nice-to-haves**
- Experience in managing physical and virtual infrastructures
- Experience with cluster management and DevOps tools (e.g. Ansible, Kubernetes)
- Experience working in an agile and innovative environment

**Why join us?**
- The work is purposeful and meaningful
- You will work with the best engineers
- We work with modern technologies and tech stacks
- We have excellent engineering culture and work-life balance
- We aspire to engineering and operational excellence
- We empower to innovate
- We grow together as a family
- As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered._

  • Big Data Platform Engineer

    2 weeks ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    **SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...

  • Engineering Manager

    1 week ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    As an Engineering Manager of Big Data Platform, you lead engineering teams to deliver Big Data platforms for running mission-critical workflows. You set the technical direction, architect, lead and manage the development Big Data Platforms. You push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...

  • Senior Big Data Platform Engineer

    5 days ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...

  • Big Data Platform Engineer

    4 days ago

    Singapore COGNIZANT TECHNOLOGY SOLUTIONS ASIA PACIFIC PTE. LTD. Full time

    Roles & Responsibilities Role & Responsibilities Operating Global Data Platform components (VM Servers, Kubernetes, Kafka) and applications (Apache stack, Collibra, Dataiku and similar). Implement automation of infrastructure, security components, and Continuous Integration & Continuous Delivery for optimal execution of data pipelines (ELT/ETL). ...

  • Big Data Platform Engineer

    12 hours ago

    Singapore COGNIZANT TECHNOLOGY SOLUTIONS ASIA PACIFIC PTE. LTD. Full time

    Roles & ResponsibilitiesRole & ResponsibilitiesOperating Global Data Platform components (VM Servers, Kubernetes, Kafka) and applications (Apache stack, Collibra, Dataiku and similar). Implement automation of infrastructure, security components, and Continuous Integration & Continuous Delivery for optimal execution of data pipelines (ELT/ETL). Develop...

  • Big Data Platform Architect

    1 week ago

    Singapore beBeeBigData Full time $90,000 - $120,000

    Job Title: Big Data Platform ArchitectWe are seeking an experienced professional to design, build, and maintain scalable big data platforms. This is a challenging role that requires strong technical skills and excellent problem-solving abilities.About the RoleThis senior position involves leading the development of big data ecosystems, ensuring high...

  • Senior Big Data Platform Architect

    5 days ago

    Singapore beBeeBigData Full time $120,000 - $180,000

    Job DescriptionAs a Senior Big Data Platform Staff Engineer, you will be responsible for designing, implementing, and maintaining the Big Data infrastructure platform. This includes managing and optimizing large-scale data processing and analytics environments.Key Responsibilities:Design, implement, and manage the Big Data infrastructure platform, including...

  • Big Data Platform Engineer

    5 days ago

    Singapore Cognizant Full time

    Qualifications DevOps tools like Jenkins, GitLab CI/CD, or similar Containerization using Docker and Kubernetes Real-time data integration using Apache Kafka Distributed SQL engines like Presto and Trino Cloud-based object storage solutions like Amazon S3 Experience with cloud migration, including assessment, planning, execution, and validation Experience...

  • Big Data Platform Engineer

    4 days ago

    Singapore Cognizant Technology Solutions Full time $90,000 - $120,000 per year

    The must have skills sets :DevOps tools like Jenkins, GitLab CI/CD, or similarContainerization using Docker and KubernetesReal-time data integration using Apache KafkaDistributed SQL engines like Presto and TrinoCloud-based object storage solutions like Amazon S3Experience with cloud migration, including assessment, planning, execution, and...

  • Big Data Engineer

    24 hours ago

    Singapore ByteDance Full time

    **Big Data Engineer (Libra) - Data Platform** - Singapore Regular - R&D Job ID: A220563 **Responsibilities** About the team Libra is a large-scale online one-stop A/B testing platform developed by Data Platform. Some of its features include: - Provides experimental evaluation services for all product lines within the company, covering solutions for...