Data Engineer(Python, Pyspark, Spark

**Job Summary**: **Salary** S$7,500 - S$11,500 / Monthly **Job Type** **Seniority** Senior **Years of Experience** At least 6 years **Tech Stacks** ETL AWS Analytics pySpark Apache Azure Spark NoSQL SQL Python **Position Overview**: As a PySpark Data Engineer, you will be responsible for designing, implementing, and maintaining data processing...

Data Engineer should be able to understand the Business requirements, Functional and Technical requirements and should build effective data transformation jobs in Python, PySpark/SCALA, Python Framework. - Should have strong hands-on working expertise in creating the optimized data pipelines in Pyspark/Python/Scala. Produce unit tests for Spark...

**Responsibilities**: - Develop enterprise grade Data Products using Spark and other Big Data frameworks - Benchmark existing solutions, identify gaps, and propose solutions to eliminate them - Be able to work within a team of data engineers, data scientists, Devops engineers, business analysts, project managers around the proposed solution and contribute...

Job Posting: Spark Developer (Data Modernization Project)About the Role: We are seeking multiple skilled and motivated Spark Developers to join a dynamic data engineering team. You will be a key contributor to a strategic, large-scale data modernization initiative for a leading global financial institution. This project involves the refactoring, upgrading,...

**Role Overview**: **Key Responsibilities**: - Design, develop, and maintain scalable **ETL pipelines** using Spark, Hive, and Hadoop. - Write efficient **SQL queries** for data extraction, transformation, and analysis. - Develop automation scripts and data processing workflows using **Python**. - Optimize data pipelines for **performance, reliability, and...

Job Description We are looking for a skilled Data Engineer with strong hands‐on experience in PySpark, Python, Big Data , and performance tuning. The role involves building and optimizing scalable data pipelines, collaborating with business users and technical stakeholders, and ensuring high‐quality data delivery in a distributed environment....

AWS Pyspark Developer What's on Offer: Industry: Consulting Location: Singapore 12 months contract role (with the possibility of extension)Competitive Compensation Job Description: Design, develop, and maintain data pipelines and ETL processes using PySpark on distributed systems. Implement scalable solutions on AWS cloud services (e.g., S3, EMR, Lambda)....

Key Responsibilities Design, develop, and maintain data pipelines and ETL processes using PySpark on distributed systems. Implement scalable solutions on AWS cloud services (e.g., S3, EMR, Lambda). Optimize data workflows for performance and reliability. Collaborate with data engineers, analysts, and business stakeholders to deliver high-quality solutions....

Data Engineer - (PySpark + Hadoop) Roles & Responsibilities - Create Spark Scala/Pyspark jobs for data transformation and aggregation. - Produce unit tests for Spark transformations and helper methods. - Used Spark and Spark-SQL to read the parquet data and create the tables in hive using the Scala API. - Work closely with Business Analysts team to review...

A leading hospitality solutions firm in Singapore is looking for a skilled Data Engineer to create efficient ETL pipelines and manage data architectures on AWS. The ideal candidate must have over 8 years of experience, with strong knowledge in Python, PySpark, and data quality measures. This role involves collaborating with data scientists to deliver...