Big Data Platform Engineer

2 days ago


Singapore Cognizant Full time

**The must have skills sets**:

- DevOps tools like Jenkins, GitLab CI/CD, or similar
- Containerization using Docker and Kubernetes
- Real-time data integration using Apache Kafka
- Distributed SQL engines like Presto and Trino
- Cloud-based object storage solutions like Amazon S3
- Experience with cloud migration, including assessment, planning, execution, and validation
- Experience with disaster recovery setup, including backup and restore processes, replication, and failover mechanisms
- Experience with Python

**Good to have -**
- Apache Spark and big data processing
- Data science platforms like Dataiku
- Ansible Playbooks to automate infrastructure provisioning, configuration, and deployment.
- Terraform to manage and provision cloud infrastructure resources

LI-CTSAPAC



  • Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...


  • Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...


  • Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** ETL ClickHouse Metastore Analytics R Flume Presto Hive Spark kafka Flink SQL **Responsibilities** TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require...


  • Singapore Tencent Full time

    Business Unit Technology Engineering Group (TEG) is responsible for supporting the company and its business groups on technology and operational platforms, as well as the construction and operation of R&D management and data centers. TEG provides users with a full range of customer services and, as the operator of the largest networking, device, and data...


  • Singapore OKX Full time

    OKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa About OKX At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto...


  • Singapore Tencent Full time

    Technology Engineering Group (TEG) is responsible for supporting the company and its business groups on technology and operational platforms, as well as the construction and operation of R&D management and data centers, TEG provides users with a full range of customer services. As the operator of the largest networking, devices, and data center in Asia, TEG...


  • Singapore TikTok Full time

    Responsibilities About TikTok TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo. Why Join Us Creation is the core of TikTok's purpose. Our platform is built to help...


  • Singapore BigTapp Full time

    **Job Title**: Big Data Platform Architect **Job Location**: Singapore **Job Purpose** The Big Data Platform Architect is responsible for the technical design and implementation of big data platform, systems integration, processes and governance to operationalize the big data platform. The Big Data Platform Architect is required to work closely with...

  • Big Data Engineer

    2 weeks ago


    Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full time

    Job Title: Big Data Engineer (Java, Spark, Hadoop)Location : Singapore Experience : 7- 12 years Employment Type : Full-Time Open to Citizens and SPR only | No Visa sponsorship available Job Summary We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep...


  • Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 1 year **Tech Stacks** ClickHouse Analytics Java Spark Scala Hadoop **Responsibilities** **About TikTok** TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok...