Data Engineering Technologist – Large-Scale Distributed Systems

6 days ago


Singapore RISKDATA CONSULTING PTE. LTD. Full time $100,000 - $150,000 per year

We are hiring Data Engineering Technologist – Large-Scale Distributed Systems with below requirements;

Responsibilities

  • Design and maintain ETL/ELT pipelines using Spark for batch and streaming data.
  • Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability.
  • Build and maintain Hive data models, partitions, and queries for analytics and reporting.
  • Improve query and pipeline performance through tuning, partitioning, bucketing, and caching.
  • Ensure data quality, governance, and security across the big data ecosystem.
  • Collaborate with data scientists, analysts, and architects to support advanced analytics and BI.

Skills

  • Experience in data engineering or big data development.
  • Strong hands-on experience in Spark (Core, SQL, Streaming).
  • Good understanding of Hadoop (HDFS, YARN) architecture.
  • Expertise in Hive data modeling, query optimization, and performance tuning.
  • Experience with cluster troubleshooting, monitoring, and scaling.
  • Knowledge of data governance and security frameworks is a plus.
  • Familiarity with cloud big data platforms (AWS EMR, Azure HDInsight, or GCP Dataproc) preferred.


  • Singapore UARROW PTE. LTD. Full time $90,000 - $120,000 per year

    Design and maintain ETL/ELT pipelines using Spark for batch and streaming data.Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability.Build and maintain Hive data models, partitions, and queries for analytics and reporting.Improve query and pipeline performance through tuning, partitioning, bucketing, and caching.Ensure data...


  • Singapore Menlo Research Pte Ltd Full time

    **About Asimov** Asimov is our open‐source humanoid robotics platform, building every layer—from structural frames and electromechanical assemblies to power electronics, cabling, and embedded control hardware. We aim to democratize advanced robotics by sharing designs, firmware, and ML models with the global community. **What to Expect** Do you want to...

  • Data Engineer

    1 week ago


    Singapore ZENITH SYSTEMS PTE. LTD. Full time

    **Role: Data Engineer** Salary Range: 7000 - 10000 SGD Location: Singapore Expected Years of Experience: 3 to 8 years Employment Type: Full-time **Key Responsibilities**: Lead the end-to-end design, development, and implementation of scalable data solutions for large-scale projects and complex change requests. - Provide technical guidance and...


  • Singapore ZETTABYTE LABS PTE. LTD. Full time

    **Job Description**: Title: Senior Distributed Systems Architect/Engineer with AI Focus Summary: **Responsibilities**: - Design, architect, and implement scalable and high-performance distributed systems. - Develop and implement solutions for high-speed networking and programmable networks. - Conduct research and development in areas such as AI,...


  • Singapore JPMorgan Chase & Co. Full time

    Overview Your opportunity to make a real impact and shape the future of financial services is waiting for you. Let's push the boundaries of what's possible together. As a Senior Director of Software Engineering at JPMorgan Chase within Equities Order Management System Technology, you lead multiple technical areas, manage the activities of multiple...

  • Backend Engineer

    5 days ago


    Singapore BYTEDANCE PTE. LTD. Full time

    **Responsibilities** ByteDance will be prioritising applicants who have a current right to work in Singapore, and do not require ByteDance's sponsorship of a visa. Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok and Helo as well as platforms specific to the China...


  • Singapore Tek Systems Full time

    Participate on platform and business driven projects Learn and leverage our systems management Engage our software development teams on feature requirements We’re hiring an experienced Windows Engineer to be deployed onsite with one of our major global financial services clients in Singapore. This is a full-time consulting role where you'll be part of the...


  • Singapore Circles.Life Full time

    Circles.Life is not just your digital telco provider. Since our launch, we revolutionised the telco industry by seamlessly integrating both telco and digital lifestyle services on our Circles-X platform. Over the past years, we have captured more than 5% market share in Singapore, launched in Australia and Taiwan while attaining record breaking CSAT and NPS...

  • Data Engineer

    1 week ago


    Singapore Hays Full time

    **Your new company** Your new company is a recognized player in the industrial space in search for an experienced Data Engineer with ideally 4+ years of relevant experience. **Your new role** - Create and maintain multiple robust and high-performance data processing pipeline within Cloud, Private Data Centre and Hybrid data ecosystem - Assemble large,...


  • Singapore ByteDance Full time

    Overview Machine Learning System Engineer - Data AML - Soaring Star Talent Program at ByteDance. Join to apply for the Machine Learning System Engineer - Data AML role at ByteDance. Responsibilities Team Introduction: Data AML is ByteDance's machine learning middle platform, providing training and inference systems for recommendation, advertising, CV,...