Data Engineer(Python, Pyspark, Spark

5 days ago


Singapore NodeFlair Full time

**Job Summary**:
**Job Type**

**Seniority**

Mid

**Years of Experience**
Information not provided

**Tech Stacks**
ETL AWS Google Cloud pySpark BigQuery RedShift Apache Azure Spark SQL Python

**Key Responsibilities**:

- Design, build, and maintain efficient, scalable, and reliable data pipelines using Python, PySpark, Spark, and SQL
- Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver appropriate data solutions
- Develop and optimize ETL (Extract, Transform, Load) processes to ensure data quality and integrity
- Implement data processing workflows for batch and real-time data integration
- Monitor and troubleshoot data pipelines, ensuring data accuracy and availability
- Perform data exploration and analysis to support business decisions Document data processes, architectures, and workflows
**Requirements**:
Proven 4+Years of experience as a Data Engineer or in a similar role.
Strong proficiency in **Python and PySpark** for data manipulation and transformation.
Hands-on experience with Apache Spark for large-scale data processing.
Advanced SQL skills for data querying, transformation, and performance tuning.
Familiarity with cloud platforms (AWS, Azure, Google Cloud) and their data services.
Experience with data warehousing concepts and technologies (e.g., Redshift, BigQuery, Snowflake).
Knowledge of best practices for data architecture and data governance.



  • Singapore Unison Consulting Pte Ltd Full time

    Key Responsibilities: - Analyze and understand existing SAS programs and datasets - Design and develop PySpark code that replicates the functionality of existing SAS programs - Optimize PySpark code for performance and scalability - Test and validate PySpark code to ensure it produces the same results as the original SAS programs - Identify and resolve...

  • Data Engineer

    7 days ago


    Singapore Infosight consulting Full time

    **Core Java** - Fundamental knowledge of distributed **architectures, SOA, Micro-services, PaaS** - Good knowledge of data manipulation using distributed data processing systems such as **Spark SQL** - Required to have good SPARKS skills - Hands-on experience on **HDFS (Hadoop), spark, impala, hive, as well as database technology** - Source Code Control...


  • Singapore Tangspac Full time

    S - Posted by Subagio Kusuma- Managing Partner Working as data engineer for a large international bank, you will be part of the global data engineering team involved in development and implementing data solutions You will be working as data engineer with a large global bank, you will be playing key role in building complex data solution Job...

  • Data Engineer Spark

    5 days ago


    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$7,500 - S$9,500 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** ETL Informatica Analytics SAP pySpark Cloudera Hive Impala Linux SQL Python **Job Summary**: - a minimum of 4 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data -...

  • Data Engineer

    7 days ago


    Singapore ZENITH INFOTECH (S) PTE LTD. Full time

    This is a 12 months contract assigned to our client Work Location: To be confirmed Salary Range : $6,000-$8,000 **Job Description**: 1. Primary Skill: Data Analytics 2. Data Engineering 3. Hands on programming skills using Python, Spark, ETL pipeline related such as Kafka, airflow. Skills Requirement (Intermidiate Level) 1. Apache Kafka 2. Apache...

  • Data Engineer

    2 hours ago


    Singapore Sembcorp Utilities Full time

    About Sembcorp Sembcorp is a leading energy and urban solutions provider headquartered in Singapore. Led by its purpose to drive energy transition, Sembcorp delivers sustainable energy solutions and urban developments by leveraging its sector expertise and global track record. Play a role in Powering Asia’s Energy Transition Drive Asia’s energy...

  • Data Engineer

    7 days ago


    Singapore Unison Consulting Pte Ltd Full time

    Overview We are seeking a skilled Data Engineer to join our team in Singapore. The ideal candidate will have strong expertise in SQL, Python, Spark, and Hive , with hands-on experience building scalable data pipelines, data models, and analytical solutions. You will work closely with data scientists, analysts, and business stakeholders to deliver...


  • Singapore PLOY ASIA PTE. Ltd Full time

    Description Summary We are seeking experienced Data Engineer to support a high-impact project involving database migration to a cloud-native data lake environment. This is a client-facing, on-site role based in Singapore , requiring strong technical expertise, excellent communication skills, and a problem-solving mindset. The ideal candidates will bring...

  • Python Developer

    2 weeks ago


    Singapore STAFFLINK SERVICES PRIVATE LIMITED Remote Work Freelance Full time

    * 5 days work week * Location: Central * Strong in Python coding like Panda, PyArrow, PySpark * 5 months renewable contract Our client is a global leader IT consulting for 500 fortune company Responsibilities: Database Migration - Proven experience migrating relational databases to cloud-native data lake solutions Programming & Processing - Python (Pandas,...


  • Singapore PLOY ASIA PTE. LTD. Full time

    Overview We are seeking experienced Data Engineer to support a high-impact project involving database migration to a cloud-native data lake environment. This is a client-facing, on-site role based in Singapore , requiring strong technical expertise, excellent communication skills, and a problem-solving mindset. The ideal candidates will bring hands-on...