Senior Data Engineer: PySpark

**Roles and Responsibilities: - **Develop Spark Scala and PySpark jobs for data transformation and aggregation.** - **Create unit tests for Spark transformations and helper methods.** - **Utilize Spark and Spark SQL to read parquet data and create tables in Hive using the Scala API.** - **Collaborate closely with the Business Analysts team to review test...

Job Posting: Spark Developer (Data Modernization Project)About the Role: We are seeking multiple skilled and motivated Spark Developers to join a dynamic data engineering team. You will be a key contributor to a strategic, large-scale data modernization initiative for a leading global financial institution. This project involves the refactoring, upgrading,...

Job Posting: Spark Developer (Data Modernization Project) About the Role: We are seeking multiple skilled and motivated Spark Developers to join a dynamic data engineering team. You will be a key contributor to a strategic, large-scale data modernization initiative for a leading global financial institution. This project involves the refactoring, upgrading,...

About Sembcorp Sembcorp is a leading energy and urban solutions provider headquartered in Singapore. Led by its purpose to drive energy transition, Sembcorp delivers sustainable energy solutions and urban developments by leveraging its sector expertise and global track record. Join us in shaping a sustainable energy future Drive Asia's energy transition with...

A leading technology consulting firm in Singapore is seeking a highly experienced Data Architect with 12-15 years of experience in data engineering. The role involves designing scalable data architectures, optimizing pipelines, and managing data engineers. Ideal candidates will possess strong skills in ELT methodologies and technologies like PySpark and...

**Responsibilities**: - Develop enterprise grade Data Products using Spark and other Big Data frameworks - Benchmark existing solutions, identify gaps, and propose solutions to eliminate them - Be able to work within a team of data engineers, data scientists, Devops engineers, business analysts, project managers around the proposed solution and contribute...

About Sembcorp Sembcorp is a leading energy and urban solutions provider headquartered in Singapore. Led by its purpose to drive energy transition, Sembcorp delivers sustainable energy solutions and urban developments by leveraging its sector expertise and global track record. Play a role in Powering Asia's Energy Transition Drive Asia's energy transition...

A dynamic technology consultancy in Singapore is seeking a Data Engineer (Azure) with expertise in Azure Data engineering, Pyspark, Python, and Power BI. The ideal candidate will design and develop ETL pipelines, dashboards, and manage data integration processes. Candidates should have a Bachelor's Degree in Computer Science or Engineering and 3-5 years of...

**Job Summary**: **Salary** S$5,000 - S$8,500 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 4 years **Tech Stacks** AWS Teradata pySpark Azure Hive Python Position : Data Engineer Experience level: 3- 8 years Project Duration: 9 months to 1 year Data Engineer with Data science skill and having experience in terms of...

A leading energy solutions provider in Singapore is seeking a highly skilled Azure Data Engineer. This role involves designing and maintaining scalable data pipelines, integrating diverse data sources, and ensuring data quality. Ideal candidates will have 3–5 years of experience with Azure Data services and strong skills in PySpark and Python. Join us to...