AWS Pyspark Developer

4 days ago


Singapore ENFACTUM PTE. LTD. Full time

Key Responsibilities Design, develop, and maintain data pipelines and ETL processes using PySpark on distributed systems. Implement scalable solutions on AWS cloud services (e.g., S3, EMR, Lambda). Optimize data workflows for performance and reliability. Collaborate with data engineers, analysts, and business stakeholders to deliver high-quality solutions. Ensure data security and compliance with organizational standards. Required Skills AWS : Hands‐on experience with core AWS services for data engineering. Python : Strong programming skills for data processing and automation. PySpark : Expertise in distributed data processing and Spark framework. SQL : Proficiency in writing complex queries and optimizing performance. Good to Have Databricks : Experience with Databricks platform for big data analytics. Knowledge of CI/CD pipelines and DevOps practices. Familiarity with data lake and data warehouse concepts. #J-18808-Ljbffr



  • Singapore Trades Workforce Solutions Full time

    AWS Pyspark Developer What's on Offer: Industry: Consulting Location: Singapore 12 months contract role (with the possibility of extension)Competitive Compensation Job Description: Design, develop, and maintain data pipelines and ETL processes using PySpark on distributed systems. Implement scalable solutions on AWS cloud services (e.g., S3, EMR, Lambda)....


  • Singapore Trades Workforce Solutions Full time

    A consulting firm is seeking an AWS Pyspark Developer located in Singapore. In this 12-month contract role, you will design, develop, and maintain data pipelines using PySpark and AWS services such as S3, EMR, and Lambda. Ideal candidates should have strong programming skills in Python, expertise in distributed data processing with PySpark, and proficiency...

  • Pyspark Developer

    2 weeks ago


    Singapore FLARE CONSULTING PTE. LTD. Full time

    Job Posting: Spark Developer (Data Modernization Project)About the Role: We are seeking multiple skilled and motivated Spark Developers to join a dynamic data engineering team. You will be a key contributor to a strategic, large-scale data modernization initiative for a leading global financial institution. This project involves the refactoring, upgrading,...

  • Data Engineer

    2 days ago


    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$7,500 - S$11,500 / Monthly **Job Type** **Seniority** Senior **Years of Experience** At least 6 years **Tech Stacks** ETL AWS Analytics pySpark Apache Azure Spark NoSQL SQL Python **Position Overview**: As a PySpark Data Engineer, you will be responsible for designing, implementing, and maintaining data processing...

  • Data Engineer

    2 weeks ago


    Singapore APAR TECHNOLOGIES PTE. LTD. Full time

    Job Description We are looking for a skilled Data Engineer with strong hands‐on experience in PySpark, Python, Big Data , and performance tuning. The role involves building and optimizing scalable data pipelines, collaborating with business users and technical stakeholders, and ensuring high‐quality data delivery in a distributed environment....


  • Singapore BASE CAMP DIGITAL PTE. LTD. Full time

    A leading technology company in Singapore is seeking a Data Engineer to design and manage data pipelines while leveraging AWS services. The role involves optimizing workflows and collaborating with teams to apply data solutions effectively. The ideal candidate should possess strong skills in AWS, Python, PySpark, and SQL to ensure high-performance data...


  • Singapore ENFACTUM PTE. LTD. Full time

    A leading technology firm in Singapore is seeking a skilled Data Engineer to design and maintain data pipelines using PySpark in a distributed environment. You will implement scalable AWS solutions, optimize workflows, and ensure data security. The ideal candidate is proficient in AWS, Python, and SQL, with expertise in data processing and automation. This...

  • Aws Data Engineer

    6 days ago


    Singapore Cognizant Full time

    **Responsibilities** - Perform end-to-end data loading using AWS Glue and Lake Formation. - Develop and manage ETL workflows using AWS Lambda, Step Functions, PySpark, and Python scripts. - Load data into AWS RDS and manage data storage in S3 Buckets. - Provide data for BI reporting using Tableau, leveraging data from S3 Buckets and RDS. - Implement and...


  • Singapore Unison Consulting Pte Ltd Full time

    **Key Responsibilities**: - Design, build, and maintain efficient, scalable, and reliable data pipelines using Python, PySpark, Spark, and SQL. - Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver appropriate data solutions. - Develop and optimize ETL (Extract, Transform, Load) processes to ensure data...

  • Aws Data Engineer

    4 days ago


    Singapore IT CONSULTANCY & SERVICES PTE LTD Full time

    Design and build production data pipelines from ingestion to consumption within a big data architecture, using DMS, DataSync & Glue. - Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming. **Requirements**: - 5 years of work experience with ETL, Data Modelling, Data Architecture to...