Big Data Platform Engineer

3 days ago

Singapore Cognizant Technology Solutions Full time $100,000 - $150,000 per year

The must have skills sets :

  • DevOps tools like Jenkins, GitLab CI/CD, or similar
  • Containerization using Docker and Kubernetes
  • Real-time data integration using Apache Kafka
  • Distributed SQL engines like Presto and Trino
  • Cloud-based object storage solutions like Amazon S3
  • Experience with cloud migration, including assessment, planning, execution, and validation
  • Experience with disaster recovery setup, including backup and restore processes, replication, and failover mechanisms
  • Experience with Python

Good to have –

  • Apache Spark and big data processing
  • Data science platforms like Dataiku
  • Ansible Playbooks to automate infrastructure provisioning, configuration, and deployment.
  • Terraform to manage and provision cloud infrastructure resources
LI-CTSAPAC

  • Big Data Platform Engineer

    4 days ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    **SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...

  • Platform Engineer – Big Data

    3 weeks ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesWe are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive. Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets. Maintain and fine-tune...

  • Platform Engineer – Big Data

    3 weeks ago

    Singapore UNISON CONSULTING PTE. LTD. Full time

    Roles & Responsibilities•Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive.•Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.•Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.•Build and...

  • Platform Engineer

    2 weeks ago

    Singapore UARROW PTE. LTD. Full time

    Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive. Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets. Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting. Build and support Hive-based...

  • Big Data Platform Engineer

    3 weeks ago

    Singapore COGNIZANT TECHNOLOGY SOLUTIONS ASIA PACIFIC PTE. LTD. Full time

    Roles & ResponsibilitiesRole & ResponsibilitiesOperating Global Data Platform components (VM Servers, Kubernetes, Kafka) and applications (Apache stack, Collibra, Dataiku and similar). Implement automation of infrastructure, security components, and Continuous Integration & Continuous Delivery for optimal execution of data pipelines (ELT/ETL). Develop...

  • Staff Platform Engineer

    2 weeks ago

    Singapore Centre for Strategic Infocomm Technologies Full time

    CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of operations, including but not limited to Counter-terrorism and Computer NetworkDefence. We are looking for talented Senior Big Data Platform Staff Engineer. Join the awesome CSIT family and use cutting-edge technologies to protect the...

  • Big Data Platform Engineer

    2 weeks ago

    Singapore Cognizant Full time

    Qualifications DevOps tools like Jenkins, GitLab CI/CD, or similar Containerization using Docker and Kubernetes Real-time data integration using Apache Kafka Distributed SQL engines like Presto and Trino Cloud-based object storage solutions like Amazon S3Experience with cloud migration, including assessment, planning, execution, and validation Experience...

  • Big Data Platform Engineer

    4 weeks ago

    Singapore Cognizant Full time

    Qualifications DevOps tools like Jenkins, GitLab CI/CD, or similar Containerization using Docker and Kubernetes Real-time data integration using Apache Kafka Distributed SQL engines like Presto and Trino Cloud-based object storage solutions like Amazon S3 Experience with cloud migration, including assessment, planning, execution, and validation Experience...

  • Big Data Platform Engineer

    2 weeks ago

    Singapore Cognizant Technology Solutions Full time

    The must have skills sets : DevOps tools like Jenkins, GitLab CI/CD, or similar Containerization using Docker and Kubernetes Real-time data integration using Apache Kafka Distributed SQL engines like Presto and Trino Cloud-based object storage solutions like Amazon S3 Experience with cloud migration, including assessment, planning, execution, and...

  • Senior Big Data Platform SRE Engineer

    1 week ago

    Singapore Tencent Full time

    Technology Engineering Group (TEG) is responsible for supporting the company and its business groups on technology and operational platforms, as well as the construction and operation of R&D management and data centers, TEG provides users with a full range of customer services. As the operator of the largest networking, devices, and data center in Asia, TEG...