Data Engineering Technologist – Large-Scale Distributed

6 days ago

Singapore UARROW PTE. LTD. Full time $90,000 - $120,000 per year

  • Design and maintain ETL/ELT pipelines using Spark for batch and streaming data.

  • Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability.

  • Build and maintain Hive data models, partitions, and queries for analytics and reporting.

  • Improve query and pipeline performance through tuning, partitioning, bucketing, and caching.

  • Ensure data quality, governance, and security across the big data ecosystem.

  • Collaborate with data scientists, analysts, and architects to support advanced analytics and BI.

Skills

  • Experience in data engineering or big data development.

  • Strong hands-on experience in Spark (Core, SQL, Streaming).

  • Good understanding of Hadoop (HDFS, YARN) architecture.

  • Expertise in Hive data modeling, query optimization, and performance tuning.

  • Experience with cluster troubleshooting, monitoring, and scaling.

  • Knowledge of data governance and security frameworks is a plus.

  • Familiarity with cloud big data platforms (AWS EMR, Azure HDInsight, or GCP Dataproc) preferred.

  • Data Engineering Technologist – Large-Scale Distributed Systems

    6 days ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time $100,000 - $150,000 per year

    We are hiring Data Engineering Technologist – Large-Scale Distributed Systems with below requirements;ResponsibilitiesDesign and maintain ETL/ELT pipelines using Spark for batch and streaming data.Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability.Build and maintain Hive data models, partitions, and queries for analytics and...

  • Project Manager

    2 weeks ago

    Central Singapore Talent Trader Group Full time

    **Responsibilities**: - Lead and manage large-scale projects from initiation to completion. - Develop and maintain project plans, including cost estimates, budgets, schedules, and resource allocation. - Coordinate with stakeholders to ensure project objectives are met. - Monitor project progress and identify and address any issues or risks that may arise. -...

  • Engineering Manager, Perf

    1 week ago

    Singapore Circles.Life Full time

    Circles.Life is not just your digital telco provider. Since our launch, we revolutionised the telco industry by seamlessly integrating both telco and digital lifestyle services on our Circles-X platform. Over the past years, we have captured more than 5% market share in Singapore, launched in Australia and Taiwan while attaining record breaking CSAT and NPS...

  • Assistant Manager, Large Scale and HyCO

    2 weeks ago

    Singapore NIPPON SANSO HOLDINGS SINGAPORE PTE. LTD. Full time

    Job Description & RequirementsWe are seeking motivated and passionate person to work as Assistant Manager, Business Development for Strategic Projects & Carbon Neutral Program stationed in Singapore reporting to regional office of Nippon Sanso Holdings Singapore (NSHS). This position will lead large-scale, integrated projects in the industrial gases and...

  • Distributed Training

    4 days ago

    Singapore Rakuten Asia Pte Ltd Full time

    Distributed Training & Inference Optimization Engineer (LLM)Join to apply for the Distributed Training & Inference Optimization Engineer (LLM)role at Rakuten Asia Pte Ltd Distributed Training & Inference Optimization Engineer (LLM)4 days ago Be among the first 25 applicants Join to apply for the Distributed Training & Inference Optimization Engineer...

  • Distributed Training

    3 hours ago

    Singapore Rakuten Asia Pte Ltd Full time

    Distributed Training & Inference Optimization Engineer (LLM)Join to apply for the Distributed Training & Inference Optimization Engineer (LLM)role at Rakuten Asia Pte Ltd Distributed Training & Inference Optimization Engineer (LLM)4 days ago Be among the first 25 applicants Join to apply for the Distributed Training & Inference Optimization Engineer...

  • Data Engineer

    1 week ago

    Singapore Hays Full time

    **Your new company** Your new company is a recognized player in the industrial space in search for an experienced Data Engineer with ideally 4+ years of relevant experience. **Your new role** - Create and maintain multiple robust and high-performance data processing pipeline within Cloud, Private Data Centre and Hybrid data ecosystem - Assemble large,...

  • Data Engineer

    2 weeks ago

    Singapore SOURCEO PTE. LTD. Full time

    **Requirements**: - Degree in Computer Science, Software Engineering, Data Science, or equivalent experience - 2+ years in data engineering, analytics, or related AI/ML role - Proficient in Python for ETL/data engineering and Spark (PySpark) for large-scale pipelines - Experience with Big Data frameworks and SQL engines (Spark SQL, Redshift, PostgreSQL) for...

  • Data Engineer

    2 weeks ago

    Singapore SOURCEO PTE. LTD. Full time

    Requirements Degree in Computer Science, Software Engineering, Data Science, or equivalent experience 2+ years in data engineering, analytics, or related AI/ML role Proficient in Python for ETL/data engineering and Spark (PySpark) for large-scale pipelines Experience with Big Data frameworks and SQL engines (Spark SQL, Redshift, PostgreSQL) for data marts...

  • Backend Engineer

    5 days ago

    Singapore BYTEDANCE PTE. LTD. Full time

    **Responsibilities** ByteDance will be prioritising applicants who have a current right to work in Singapore, and do not require ByteDance's sponsorship of a visa. Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok and Helo as well as platforms specific to the China...