Current jobs related to Big Data Platform Architect - Singapore - beBeeBigData

  • Platform Engineer – Big Data

    1 week ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesWe are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive. Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets. Maintain and fine-tune...

  • Data Architect

    1 week ago

    Singapore beBeeData Full time $120,000 - $150,000

    Big Data Platform SpecialistWe are seeking a highly skilled Big Data Platform Specialist to join our team. As a key member, you will design and implement big data platforms built on Hadoop, Spark, and Hive.About the RoleDesign and implement big data platforms using Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage...

  • Platform Engineer – Big Data

    2 weeks ago

    Singapore UNISON CONSULTING PTE. LTD. Full time

    Roles & Responsibilities•Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive.•Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.•Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.•Build and...

  • Platform Engineer – Big Data

    1 week ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time $104,000 - $130,878 per year

    We are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN)...

  • Platform Engineer – Big Data

    1 week ago

    Singapore UARROW PTE. LTD. Full time $104,000 - $130,878 per year

    Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.Build and support Hive-based data warehouses for...

  • Platform Engineer

    4 days ago

    Singapore UARROW PTE. LTD. Full time

    Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive. Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets. Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting. Build and support Hive-based...

  • Big Data Architect

    1 week ago

    Singapore beBeeDataEngineering Full time $90,000 - $120,000

    Job Title: Data Engineering LeadWe are seeking a skilled Data Engineering Lead to join our team. As a key member of our Professional Services group, you will work with clients on short to medium term customer engagements solving their big data problems using Apache Spark and the Databricks Data Intelligence Platform.About the RoleThe ideal candidate will...

  • Data Platform Architect

    2 weeks ago

    Singapore Newtone Consulting Full time

    **Role and responsibilities**: - Provide the architectural view of the solution and will be responsible for the technical documentations necessary for validations in the technical committees of the bank - Responsible for the Data platform TAD (Technical Architecture Document) - Responsible for ensuring the security requirements - Contribute to the design of...

  • Big Data Engineer, Data Platform

    1 week ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** ETL ClickHouse Metastore Analytics R Flume Presto Hive Spark kafka Flink SQL **Responsibilities** TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require...

  • Big Data Architect

    1 week ago

    Singapore beBeeData Full time $90,000 - $120,000

    Unlock the Potential of Cloud-Native Big Data PlatformsAs a trusted technical consultant, you will guide enterprise customers through solution design, implementation, and best practices for cloud-based big data platforms.

Big Data Platform Architect

3 weeks ago

Singapore beBeeBigData Full time $90,000 - $120,000

Job Title: Big Data Platform Architect

We are seeking an experienced professional to design, build, and maintain scalable big data platforms. This is a challenging role that requires strong technical skills and excellent problem-solving abilities.

About the Role

This senior position involves leading the development of big data ecosystems, ensuring high availability and performance at scale. The successful candidate will have experience with distributed systems, cloud computing, and containerization technologies.

Key Responsibilities
  • Design and deploy big data platforms using Hadoop, Spark, Flink, and Kafka.
  • Optimize data pipelines for ingestion, transformation, and storage, leveraging tools like NiFi, Airflow, or Luigi.
  • Manage cluster resources and monitor platform health using YARN, Prometheus, Grafana, or Datadog.
  • Implement end-to-end CI/CD pipelines using Jenkins, GitLab CI/CD, or GitHub Actions.
  • Develop and enforce DevOps best practices, including logging, monitoring, backup strategies, and disaster recovery plans.
Requirements
  • At least 2 years of experience in big data engineering and DevOps.
  • Strong knowledge of Linux, Python, and scripting languages.
  • Experience with containerization technologies such as Docker and Kubernetes.
  • Good understanding of data processing, analytics, and visualization.
  • Familiarity with DevOps tools and methodologies.
Benefits

This is a contract role with opportunities for professional growth and development. The successful candidate will have the chance to work on challenging projects and collaborate with a talented team of professionals.