Spark Data Engineer
3 days ago
Our client is looking for an experienced Spark data Engineer to join their team in Singapore.
Cloudera - CCA Spark and Hadoop Developer (CCA175)
Databricks Certified Developer: Apache Spark 2.X
Hortonworks - HDP Certified Apache Spark Developer
- Strong Hadoop, Distributed Computing and Cluster Knowledge, Cloudera Distribution experience is a plus.
- Good knowledge in Scala (with a focus on the functional programming paradigm)
- Hands on experience in spark using Scala, Good hands on experience on DataFrame, RDD logic, looping concepts and Hadoop architecture.
- Data transformation pipeline design/development knowledge is required.
- Need to have Strong problem solving and performance improvement skill.
- Create Scala/Spark jobs for data transformation and aggregation
- Produce unit tests for Spark transformations and helper methods
- Design data processing pipelines
-
Data Engineer/senior
5 days ago
Changi, Singapore SATS Full time**About us** About SATS - Feed and Connect Communities** SATS is a global leader in gateway services and Asia's pre-eminent provider of food solutions. Using innovative food technologies and resilient supply chains, we create tasty, quality food in sustainable ways for airlines, foodservice chains, retailers, and institutions. With heartfelt service and...
-
Senior Data Engineer, Sensor
2 weeks ago
Changi, East Region, Singapore Changi Airport Group Full time $120,000 - $180,000 per yearJob description:About the jobAs a Machine Learning Data Engineer at CAG, you will be responsible for designing, implementing, and maintaining the data pipelines and infrastructure that support our machine learning projects. You will work closely with data scientists, machine learning engineers, cloud engineer and other cross-functional teams to ensure the...
-
Data Engineer
5 days ago
Changi Airport, Singapore CAA Civil Aviation Authority of Singapore Full time[What the role is] [What you will be working on] - Architect and implement scalable data systems: Utilize your expertise to design and implement robust and scalable data systems. - Develop efficient data pipelines that securely collect, transform, and distribute large volumes of data while ensuring data integrity and compliance. - Drive production services...
-
Assistant Manager, Data Engineering
1 week ago
Changi, Singapore Changi Airport Group (Singapore) Pte. Ltd. Full time $80,000 - $120,000 per yearCompany description: Changi Airport Group (CAG) is the manager of Singapore Changi Airport, a leading air hub in Asia and one of the world's most awarded airports. As airport manager, CAG performs the key functions of airport operations, air hub development, retail and commercial activities, infrastructure development and airport emergency services. CAG...
-
Kafka Streaming Developer
3 days ago
Changi, Singapore G&L Consulting Full timeOur client is looking for an experienced Kafka Streaming Developer to join their team in Singapore. Kafka-> Confluent Certified Administrator for Apache Kafka Kafka-> Confluent Certified Developer for Apache Kafka Talend-> Talend Data Integration v6 Certified Developer Apache Spark-> Cloudera - CCA Spark and Hadoop Developer (CCA175) Apache Spark->...
-
Software Backend Engineer
2 weeks ago
Changi, Singapore Thales Full timeLocation: Singapore, Singapore Thales people architect solutions that are relied upon to deliver operational advantage at every decisive moment throughout the mission. Defence and armed forces customers rely on us to deliver the full range of defensive systems for land, sea, and air. From early warning, to threat neutralisation, our platforms cover all...
-
SQL/Hadoop Developer
7 days ago
Changi, Singapore QUESS SINGAPORE Full time $90,000 - $120,000 per yearKey Responsibilities:Develop, optimize, and maintain SQL queries and stored procedures.Work with large datasets using Hadoop ecosystem tools such as HDFS, Hive, Pig, and Spark.Design and implement data processing pipelines using Spark (PySpark/Scala).Collaborate with cross-functional teams to understand data requirements.Ensure data quality, integrity, and...
-
Data Scientist
2 weeks ago
Changi, Singapore Changi Airport Group (Singapore) Pte. Ltd. Full time $120,000 - $150,000 per yearThis role focuses primarily on data science development and delivery, while also supports AI enablement and training initiatives to build organisation-wide AI awareness and adoption. The ideal candidate is hands-on with data science projects, yet comfortable engaging stakeholders and helping to upskill colleagues in responsible and effective AI use.Key...
-
Data Scientist
1 week ago
Changi, Singapore Changi Airport Group (Singapore) Pte. Ltd. Full time $150,000 - $250,000 per yearCompany description: Changi Airport Group (CAG) is the manager of Singapore Changi Airport, a leading air hub in Asia and one of the world's most awarded airports. As airport manager, CAG performs the key functions of airport operations, air hub development, retail and commercial activities, infrastructure development and airport emergency services. CAG...
-
Assistant Manager, Data Engineering
2 weeks ago
Changi, East Region, Singapore Changi Airport Group Full time $80,000 - $120,000 per yearJob description:Changi Airport Group (CAG) is seeking dynamic and motivated individuals to join the Innovation and Process Enhancement team within the Engineering & Development Cluster (E&D). As a key player in the aviation industry, CAG is committed to leveraging cutting-edge technologies and fostering creativity to enhance engineering systems and...