Data Engineering Technologist – Large-Scale Distributed Systems

3 days ago


Singapore RISKDATA CONSULTING PTE. LTD. Full time
Roles & Responsibilities

We are hiring Data Engineering Technologist – Large-Scale Distributed Systems with below requirements;

Responsibilities

  • Design and maintain ETL/ELT pipelines using Spark for batch and streaming data.
  • Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability.
  • Build and maintain Hive data models, partitions, and queries for analytics and reporting.
  • Improve query and pipeline performance through tuning, partitioning, bucketing, and caching.
  • Ensure data quality, governance, and security across the big data ecosystem.
  • Collaborate with data scientists, analysts, and architects to support advanced analytics and BI.

Skills

  • Experience in data engineering or big data development.
  • Strong hands-on experience in Spark (Core, SQL, Streaming).
  • Good understanding of Hadoop (HDFS, YARN) architecture.
  • Expertise in Hive data modeling, query optimization, and performance tuning.
  • Experience with cluster troubleshooting, monitoring, and scaling.
  • Knowledge of data governance and security frameworks is a plus.
  • Familiarity with cloud big data platforms (AWS EMR, Azure HDInsight, or GCP Dataproc) preferred.
Tell employers what skills you have

Scalability
Azure
Big Data
Data Modeling
Pipelines
Hadoop
Architects
Data Quality
Data Governance
Reliability
Tuning
Data Engineering
EMR
Distributed Systems
Performance Tuning
GCP

  • Singapore RISKDATA CONSULTING PTE. LTD. Full time

    We are hiring Data Engineering Technologist - Large-Scale Distributed Systems with below requirements; **Responsibilities** - Design and maintain ETL/ELT pipelines using Spark for batch and streaming data. - Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability. - Build and maintain Hive data models, partitions, and queries for...


  • Singapore RISKDATA CONSULTING PTE. LTD. Full time $104,000 - $130,878 per year

    We are hiring Data Engineering Technologist – Large-Scale Distributed Systems with below requirements;ResponsibilitiesDesign and maintain ETL/ELT pipelines using Spark for batch and streaming data.Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability.Build and maintain Hive data models, partitions, and queries for analytics and...


  • Singapore beBeeReliability Full time $125,000 - $175,000

    Job TitleA senior site reliability engineer is needed to ensure the smooth operation of large-scale distributed systems.Design, deploy, and manage CI/CD pipelines to deliver software consistently.Administer, scale, and optimize Kubernetes deployments for high availability and fault tolerance.Architect and maintain microservices infrastructure for seamless...


  • Singapore beBeeDataEngineering Full time $120,000 - $180,000

    Large Scale Data Engineering ExpertWe are seeking an experienced Large Scale Data Engineering Expert to join our team. As a key member of our team, you will play a vital role in designing and maintaining large-scale distributed systems.The ideal candidate will have hands-on experience with Spark (Core, SQL, Streaming), a good understanding of Hadoop (HDFS,...


  • Singapore beBeeDataEngineering Full time

    Large Scale Data Engineering Expert We are seeking an experienced Large Scale Data Engineering Expert to join our team. As a key member of our team, you will play a vital role in designing and maintaining large-scale distributed systems. The ideal candidate will have hands-on experience with Spark (Core, SQL, Streaming), a good understanding of Hadoop...


  • Singapore beBeeDataEngineer Full time $180,000 - $240,000

    As a seasoned data engineering professional, you will play a key role in the design and implementation of large-scale distributed systems.Job DescriptionThe ideal candidate will possess a strong background in data engineering or big data development, with hands-on experience in Spark (Core, SQL, Streaming). They should also have a solid understanding of...


  • Singapore beBeeDataEngineer Full time

    As a seasoned data engineering professional, you will play a key role in the design and implementation of large-scale distributed systems. Job Description The ideal candidate will possess a strong background in data engineering or big data development, with hands-on experience in Spark (Core, SQL, Streaming). They should also have a solid understanding...


  • Singapore beBeeData Full time $120,000 - $180,000

    We are seeking a skilled Big Data Engineer to join our E-commerce Recommendation Infrastructure team.Job DescriptionThis role involves designing and implementing large-scale recommendation systems, ensuring high-performance storage and computing systems, and troubleshooting production issues. You will work closely with applied machine learning engineers to...


  • Singapore RISKDATA CONSULTING PTE. LTD. Full time

    Roles & Responsibilities We are hiring Data Engineering Technologist – Large-Scale Distributed Systems with below requirements; Responsibilities Design and maintain ETL/ELT pipelines using Spark for batch and streaming data. Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability. Build and maintain Hive data models,...

  • Data Engineer

    3 days ago


    Singapore beBeeDataEngineer Full time $80,000 - $120,000

    Job DescriptionOur team is responsible for designing and implementing large-scale recommendation systems. We focus on optimizing the architecture to provide a stable and high-quality experience for users.We are looking for talented individuals to join our team. As a graduate, you will have opportunities to pursue bold ideas, tackle complex challenges, and...