Spark Data Engineer

3 days ago


Changi, Singapore G&L Consulting Full time

Our client is looking for an experienced Spark data Engineer to join their team in Singapore.

Cloudera - CCA Spark and Hadoop Developer (CCA175)
Databricks Certified Developer: Apache Spark 2.X
Hortonworks - HDP Certified Apache Spark Developer
- Strong Hadoop, Distributed Computing and Cluster Knowledge, Cloudera Distribution experience is a plus.
- Good knowledge in Scala (with a focus on the functional programming paradigm)
- Hands on experience in spark using Scala, Good hands on experience on DataFrame, RDD logic, looping concepts and Hadoop architecture.
- Data transformation pipeline design/development knowledge is required.
- Need to have Strong problem solving and performance improvement skill.
- Create Scala/Spark jobs for data transformation and aggregation
- Produce unit tests for Spark transformations and helper methods
- Design data processing pipelines



  • Changi, Singapore SATS Full time

    **About us** About SATS - Feed and Connect Communities** SATS is a global leader in gateway services and Asia's pre-eminent provider of food solutions. Using innovative food technologies and resilient supply chains, we create tasty, quality food in sustainable ways for airlines, foodservice chains, retailers, and institutions. With heartfelt service and...


  • Changi, East Region, Singapore Changi Airport Group Full time $120,000 - $180,000 per year

    Job description:About the jobAs a Machine Learning Data Engineer at CAG, you will be responsible for designing, implementing, and maintaining the data pipelines and infrastructure that support our machine learning projects. You will work closely with data scientists, machine learning engineers, cloud engineer and other cross-functional teams to ensure the...

  • Data Engineer

    5 days ago


    Changi Airport, Singapore CAA Civil Aviation Authority of Singapore Full time

    [What the role is] [What you will be working on] - Architect and implement scalable data systems: Utilize your expertise to design and implement robust and scalable data systems. - Develop efficient data pipelines that securely collect, transform, and distribute large volumes of data while ensuring data integrity and compliance. - Drive production services...


  • Changi, Singapore Changi Airport Group (Singapore) Pte. Ltd. Full time $80,000 - $120,000 per year

    Company description: Changi Airport Group (CAG) is the manager of Singapore Changi Airport, a leading air hub in Asia and one of the world's most awarded airports. As airport manager, CAG performs the key functions of airport operations, air hub development, retail and commercial activities, infrastructure development and airport emergency services. CAG...


  • Changi, Singapore G&L Consulting Full time

    Our client is looking for an experienced Kafka Streaming Developer to join their team in Singapore. Kafka-> Confluent Certified Administrator for Apache Kafka Kafka-> Confluent Certified Developer for Apache Kafka Talend-> Talend Data Integration v6 Certified Developer Apache Spark-> Cloudera - CCA Spark and Hadoop Developer (CCA175) Apache Spark->...


  • Changi, Singapore Thales Full time

    Location: Singapore, Singapore Thales people architect solutions that are relied upon to deliver operational advantage at every decisive moment throughout the mission. Defence and armed forces customers rely on us to deliver the full range of defensive systems for land, sea, and air. From early warning, to threat neutralisation, our platforms cover all...


  • Changi, Singapore QUESS SINGAPORE Full time $90,000 - $120,000 per year

    Key Responsibilities:Develop, optimize, and maintain SQL queries and stored procedures.Work with large datasets using Hadoop ecosystem tools such as HDFS, Hive, Pig, and Spark.Design and implement data processing pipelines using Spark (PySpark/Scala).Collaborate with cross-functional teams to understand data requirements.Ensure data quality, integrity, and...

  • Data Scientist

    2 weeks ago


    Changi, Singapore Changi Airport Group (Singapore) Pte. Ltd. Full time $120,000 - $150,000 per year

    This role focuses primarily on data science development and delivery, while also supports AI enablement and training initiatives to build organisation-wide AI awareness and adoption. The ideal candidate is hands-on with data science projects, yet comfortable engaging stakeholders and helping to upskill colleagues in responsible and effective AI use.Key...

  • Data Scientist

    1 week ago


    Changi, Singapore Changi Airport Group (Singapore) Pte. Ltd. Full time $150,000 - $250,000 per year

    Company description: Changi Airport Group (CAG) is the manager of Singapore Changi Airport, a leading air hub in Asia and one of the world's most awarded airports. As airport manager, CAG performs the key functions of airport operations, air hub development, retail and commercial activities, infrastructure development and airport emergency services. CAG...


  • Changi, East Region, Singapore Changi Airport Group Full time $80,000 - $120,000 per year

    Job description:Changi Airport Group (CAG) is seeking dynamic and motivated individuals to join the Innovation and Process Enhancement team within the Engineering & Development Cluster (E&D). As a key player in the aviation industry, CAG is committed to leveraging cutting-edge technologies and fostering creativity to enhance engineering systems and...