Data Engineering Technologist – Large-Scale Distributed

6 days ago


Singapur, Singapore UARROW PTE. LTD. Full time

Responsibilities

  • Design and maintain ETL/ELT pipelines using Spark for batch and streaming data.
  • Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability.
  • Build and maintain Hive data models, partitions, and queries for analytics and reporting.
  • Improve query and pipeline performance through tuning, partitioning, bucketing, and caching.
  • Ensure data quality, governance, and security across the big data ecosystem.
  • Collaborate with data scientists, analysts, and architects to support advanced analytics and BI.
Qualifications
  • Experience in data engineering or big data development.
  • Strong hands-on experience in Spark (Core, SQL, Streaming).
  • Good understanding of Hadoop (HDFS, YARN) architecture.
  • Expertise in Hive data modeling, query optimization, and performance tuning.
  • Experience with cluster troubleshooting, monitoring, and scaling.
  • Knowledge of data governance and security frameworks is a plus.
  • Familiarity with cloud big data platforms (AWS EMR, Azure HDInsight, or GCP Dataproc) preferred.
#J-18808-Ljbffr
  • Data Engineer

    6 days ago


    Singapur, Singapore UARROW PTE. LTD. Full time

    Overview We are seeking a highly skilled Data Engineer to join our team and contribute to building scalable, reliable, and high-performance data platforms. The ideal candidate will have strong expertise in Python, SQL, Spark, and hands-on experience with cloud-based big data platforms such as Databricks. Responsibilities Design, develop, and maintain...


  • Singapur, Singapore REGTECH INSIGHT PTE. LTD. Full time

    We are seeking a highly skilled Senior Data Engineer to join our team and contribute to building scalable, reliable, and high-performance data platforms. The ideal candidate will have strong expertise in Python, SQL, Spark, and hands-on experience with cloud-based big data platforms such as Databricks. Key Responsibilities Design, develop, and maintain...


  • Singapur, Singapore JEET ANALYTICS PTE. LTD. Full time

    Overview We are seeking a highly skilled Senior Data Engineer to join our team and contribute to building scalable, reliable, and high-performance data platforms. The ideal candidate will have strong expertise in Python, SQL, Spark , and hands-on experience with cloud-based big data platforms such as Databricks . Responsibilities Design, develop, and...


  • Singapur, Singapore Unison Consulting Pte Ltd Full time

    Job Description: We are seeking a highly skilled Senior Data Engineer to join our team and contribute to building scalable, reliable, and high-performance data platforms. The ideal candidate will have strong expertise in Python, SQL, Spark , and hands-on experience with cloud-based big data platforms such as Databricks . Key Responsibilities: Design,...


  • Singapur, Singapore Newbridgealliance Full time

    Head of Data Engineering – Newbridge We are looking for a talented Head of Data Engineering to lead and execute various data engineering activities, ensuring seamless operations and compliance with regulatory requirements. Key Responsibilities Design, develop, and maintain large-scale data engineering systems to support business growth and analytics Lead...


  • Singapur, Singapore JPMorgan Chase & Co. Full time

    Overview Your opportunity to make a real impact and shape the future of financial services is waiting for you. Let’s push the boundaries of what's possible together. As a Senior Director of Software Engineering at JPMorgan Chase within Equities Order Management System Technology, you lead multiple technical areas, manage the activities of multiple...


  • Singapur, Singapore SGInnovate Full time

    This role is with Auristone , a startup supported by SGInnovate. Auristone is an Asian-based epigenomic profiling company with data analytics capabilities that spun out from Genome Institute of Singapore (GIS) in 2021 with the vision to be the largest curator of Asian Epigenomic database to drive epigenomic discoveries. We are currently seeking a...


  • Singapur, Singapore Newbridge Full time

    Overview We are looking for a talented Head of Data Engineering to lead and execute various data engineering activities, ensuring seamless operations and compliance with regulatory requirements. Responsibilities Design, develop, and maintain large-scale data engineering systems to support business growth and analytics Lead and manage a team of data engineers...

  • Data Engineer

    6 days ago


    Singapur, Singapore Paradigm Full time

    Join to apply for the Data Engineer role at Paradigm 2 days ago Be among the first 25 applicants Join to apply for the Data Engineer role at Paradigm About ParadexParadex isn’t just another decentralized exchange—it’s a Super App. We’ve combined three powerful financial primitives: Exchange, Asset Management, and Borrow/Lend Markets, all...


  • Singapur, Singapore Airswift Full time

    Overview A leader in Shipping and Logistics company is currently expanding and looking for highly qualified candidates for the Data Engineer position based in Singapore. Responsibilities Design, build, and maintain scalable ETL/ELT pipelines to ingest data from diverse sources including internal systems, APIs, and web platforms Ensure the availability of...