Data Engineer

1 week ago

Singapur, Singapore Unison Consulting Pte Ltd Full time

Overview

We are looking for a skilled Data Engineer with 5 years of hands-on experience in designing, developing, and optimizing big data pipelines and solutions. The ideal candidate will have strong expertise in SQL, Python, Apache Spark, Hive, and Hadoop ecosystems and will be responsible for building scalable data platforms to support business intelligence, analytics, and machine learning use cases.

Responsibilities
  • Design, develop, and maintain scalable ETL pipelines using Spark, Hive, and Hadoop.
  • Write efficient SQL queries for data extraction, transformation, and analysis.
  • Develop automation scripts and data processing workflows using Python.
  • Optimize data pipelines for performance, reliability, and scalability.
  • Work with structured and unstructured data from multiple sources.
  • Ensure data quality, governance, and security throughout the data lifecycle.
  • Collaborate with cross-functional teams (Data Scientists, Analysts, and Business stakeholders) to deliver data-driven solutions.
  • Monitor and troubleshoot production data pipelines.
Requirements
  • 5+ years of experience in Data Engineering / Big Data development.
  • Strong expertise in SQL (query optimization, performance tuning, stored procedures).
  • Proficiency in Python for data manipulation, scripting, and automation.
  • Hands-on experience with Apache Spark (PySpark/Scala) for large-scale data processing.
  • Solid knowledge of Hive for querying and managing data in Hadoop environments.
  • Strong working knowledge of Hadoop ecosystem (HDFS, YARN, MapReduce, etc.).
  • Experience with data pipeline orchestration tools (Airflow, Oozie, or similar) is a plus.
  • Familiarity with cloud platforms (AWS, Azure, or GCP) is preferred.
  • Excellent problem-solving, debugging, and communication skills
Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Other

Industries

IT Services and IT Consulting

#J-18808-Ljbffr

  • Associate Business Analyst

    4 weeks ago

    Singapur, Singapore NTT DATA, Inc. Full time

    Associate Business Analyst / Quality Analyst Engineer Join to apply for the Associate Business Analyst / Quality Analyst Engineer role at NTT DATA, Inc. Associate Business Analyst / Quality Analyst Engineer Join to apply for the Associate Business Analyst / Quality Analyst Engineer role at NTT DATA, Inc. Make an impact with NTT DATAJoin a company that is...

  • Cross Technology Service Delivery Field Support Engineer

    4 weeks ago

    Singapur, Singapore NTT DATA, Inc. Full time

    Cross Technology Service Delivery Field Support Engineer (L2) Join to apply for the Cross Technology Service Delivery Field Support Engineer (L2) role at NTT DATA, Inc. Cross Technology Service Delivery Field Support Engineer (L2) 1 week ago Be among the first 25 applicants Join to apply for the Cross Technology Service Delivery Field Support Engineer (L2)...

  • Cross Technology Service Delivery Field Support Engineer

    4 weeks ago

    Singapur, Singapore NTT DATA, Inc. Full time

    Overview Cross Technology Service Delivery Field Support Engineer (L2) -1 at NTT T DATA, Inc. Join to apply for the Cross Technology Service Delivery Field Support Engineer (L2)-1 role at NTT DATA, Inc. Make an impact with NTT DATA — Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and...

  • Data Engineer

    4 weeks ago

    Singapur, Singapore Innova Solutions Full time

    Direct message the job poster from Innova Solutions Overview We are seeking a skilled Data Engineer with strong SSIS development expertise to design, build, and maintain scalable data integration solutions. The ideal candidate will have experience in ETL processes, SQL Server, and data warehouse development, with the ability to translate business...

  • Data Engineer

    2 days ago

    Singapur, Singapore CLOUD KINETICS CONSULTING PTE. LTD. Full time

    Overview We are seeking an experienced Data Engineer to join our Data team in Singapore. The ideal candidate will have a proven track record of hands-on data engineering experience, particularly within the AWS and Azure. As a Data Engineer, you will be responsible for developing and maintaining data pipelines, ensuring the reliability, efficiency, and...

  • Data Engineer

    4 weeks ago

    Singapur, Singapore SMRT TRAINS LTD. Full time

    Job Purpose The Data Engineer will be part of the team to develop operation & maintenance decision-support tools to enhance train reliability and maintenance efficiency. This position involves designing, developing, and maintaining data pipelines, APIs, and cloud infrastructure for various rail-oriented applications. The ideal candidate will have expertise...

  • Data Engineer

    4 days ago

    Singapur, Singapore StarHub Full time

    Join to apply for the Data Engineer role at StarHub 5 days ago Be among the first 25 applicants Join to apply for the Data Engineer role at StarHub Get AI-powered advice on this job and more exclusive features. Job Description As a Data Engineer, you’ll work with large-scale, heterogeneous datasets and hybrid cloud architectures to support analytics and AI...

  • Data Engineer

    2 days ago

    Singapur, Singapore NEXadept Full time

    Direct message the job poster from NEXadept Overview Connecting Great Jobs with Great People! Responsibilities Design, build, and maintain scalable and reliable data pipelines to process large datasets from diverse advertising and marketing platforms. Develop and implement data models, ETL workflows, and automation frameworks to support performance...

  • Data Engineer

    4 weeks ago

    Singapur, Singapore Razer USA Ltd. Full time

    Data Engineer page is loaded## Data Engineerlocations: Singaporetime type: Full timeposted on: Posted Todayjob requisition id: JR Joining Razer will place you on a global mission to revolutionize the way the world games. Razer is **a place to do great work**, offering you the opportunity to make an impact globally while working across a global team...

  • Data Engineer

    4 weeks ago

    Singapur, Singapore Sembcorp Industries Ltd Full time

    Join to apply for the Data Engineer role at Sembcorp Industries Ltd 3 days ago Be among the first 25 applicants Join to apply for the Data Engineer role at Sembcorp Industries Ltd About SembcorpSembcorp is a leading energy and urban solutions provider headquartered in Singapore. Led by its purpose to drive energy transition, Sembcorp delivers sustainable...