Data Engineering Technologist – Large-Scale Distributed Systems

4 days ago


Singapore RISKDATA CONSULTING PTE. LTD. Full time $104,000 - $130,878 per year

We are hiring Data Engineering Technologist – Large-Scale Distributed Systems with below requirements;

Responsibilities

  • Design and maintain ETL/ELT pipelines using Spark for batch and streaming data.
  • Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability.
  • Build and maintain Hive data models, partitions, and queries for analytics and reporting.
  • Improve query and pipeline performance through tuning, partitioning, bucketing, and caching.
  • Ensure data quality, governance, and security across the big data ecosystem.
  • Collaborate with data scientists, analysts, and architects to support advanced analytics and BI.

Skills

  • Experience in data engineering or big data development.
  • Strong hands-on experience in Spark (Core, SQL, Streaming).
  • Good understanding of Hadoop (HDFS, YARN) architecture.
  • Expertise in Hive data modeling, query optimization, and performance tuning.
  • Experience with cluster troubleshooting, monitoring, and scaling.
  • Knowledge of data governance and security frameworks is a plus.
  • Familiarity with cloud big data platforms (AWS EMR, Azure HDInsight, or GCP Dataproc) preferred.


  • Singapore RISKDATA CONSULTING PTE. LTD. Full time

    We are hiring Data Engineering Technologist - Large-Scale Distributed Systems with below requirements; **Responsibilities** - Design and maintain ETL/ELT pipelines using Spark for batch and streaming data. - Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability. - Build and maintain Hive data models, partitions, and queries for...


  • Singapore RISKDATA CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesWe are hiring Data Engineering Technologist – Large-Scale Distributed Systems with below requirements;ResponsibilitiesDesign and maintain ETL/ELT pipelines using Spark for batch and streaming data. Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability. Build and maintain Hive data models, partitions, and...


  • Singapore beBeeReliability Full time $125,000 - $175,000

    Job TitleA senior site reliability engineer is needed to ensure the smooth operation of large-scale distributed systems.Design, deploy, and manage CI/CD pipelines to deliver software consistently.Administer, scale, and optimize Kubernetes deployments for high availability and fault tolerance.Architect and maintain microservices infrastructure for seamless...


  • Singapore beBeeDataEngineering Full time

    Large Scale Data Engineering Expert We are seeking an experienced Large Scale Data Engineering Expert to join our team. As a key member of our team, you will play a vital role in designing and maintaining large-scale distributed systems. The ideal candidate will have hands-on experience with Spark (Core, SQL, Streaming), a good understanding of Hadoop...


  • Singapore beBeeDataEngineering Full time $120,000 - $180,000

    Large Scale Data Engineering ExpertWe are seeking an experienced Large Scale Data Engineering Expert to join our team. As a key member of our team, you will play a vital role in designing and maintaining large-scale distributed systems.The ideal candidate will have hands-on experience with Spark (Core, SQL, Streaming), a good understanding of Hadoop (HDFS,...


  • Singapore beBeeDataEngineer Full time $180,000 - $240,000

    As a seasoned data engineering professional, you will play a key role in the design and implementation of large-scale distributed systems.Job DescriptionThe ideal candidate will possess a strong background in data engineering or big data development, with hands-on experience in Spark (Core, SQL, Streaming). They should also have a solid understanding of...


  • Singapore beBeeDataEngineer Full time

    As a seasoned data engineering professional, you will play a key role in the design and implementation of large-scale distributed systems. Job Description The ideal candidate will possess a strong background in data engineering or big data development, with hands-on experience in Spark (Core, SQL, Streaming). They should also have a solid understanding...


  • Singapore beBeeData Full time $120,000 - $180,000

    We are seeking a skilled Big Data Engineer to join our E-commerce Recommendation Infrastructure team.Job DescriptionThis role involves designing and implementing large-scale recommendation systems, ensuring high-performance storage and computing systems, and troubleshooting production issues. You will work closely with applied machine learning engineers to...


  • Singapore RISKDATA CONSULTING PTE. LTD. Full time

    Roles & Responsibilities We are hiring Data Engineering Technologist – Large-Scale Distributed Systems with below requirements; Responsibilities Design and maintain ETL/ELT pipelines using Spark for batch and streaming data. Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability. Build and maintain Hive data models,...

  • Data Engineer

    4 days ago


    Singapore beBeeDataEngineer Full time $80,000 - $120,000

    Job DescriptionOur team is responsible for designing and implementing large-scale recommendation systems. We focus on optimizing the architecture to provide a stable and high-quality experience for users.We are looking for talented individuals to join our team. As a graduate, you will have opportunities to pursue bold ideas, tackle complex challenges, and...