Unison Consulting Pte Ltd | Data Engineer(Hadoop, Spark, Scala)
2 days ago
Job Responsibilities
Design, develop, and maintain scalable data pipelines and ETL processes using Hadoop and Spark.
Write efficient and optimized data processing jobs in Scala to transform and load data.
Utilize SQL for querying and manipulating data across various databases.
Collaborate with data scientists and analysts to gather requirements and deliver data solutions that meet business needs.
Monitor and troubleshoot data processing workflows to ensure high performance and reliability.
Implement best practices for data quality, governance, and security.
Document data engineering processes, workflows, and architecture for team knowledge sharing.
Stay updated on industry trends and emerging technologies to continuously improve our data strategies.
Requirements
Bachelor’s degree in Computer Science, Engineering, or a related field.
3+ years of experience as a Data Engineer or in a similar role.
Strong proficiency in Hadoop ecosystem components (e.g., HDFS, Hive, Pig).
Hands-on experience with Apache Spark for big data processing.
Proficient in Scala programming for data transformation tasks.
Advanced SQL skills for querying and managing large datasets.
Experience with data modeling, data warehousing, and ETL processes.
Familiarity with cloud platforms (AWS, GCP, or Azure) is a plus.
Strong analytical and problem-solving skills.
#J-18808-Ljbffr
-
Data Engineer
2 days ago
Singapore APAR TECHNOLOGIES PTE. LTD. Full timeRoles & ResponsibilitiesWe are seeking a skilled and motivated Data EngineerWith expertise in Scala, SQL, and Hadoop, to join our dynamic team. In this role, you will design, develop, and maintain scalable data pipelines and systems to process large datasets. You will collaborate with cross-functional teams to deliver high-quality solutions for data storage,...
-
Data Engineer
1 day ago
Singapore APAR TECHNOLOGIES PTE. LTD. Full timeRoles & ResponsibilitiesWe are seeking a skilled and motivated Data EngineerWith expertise in Scala, SQL, and Hadoop, to join our dynamic team. In this role, you will design, develop, and maintain scalable data pipelines and systems to process large datasets. You will collaborate with cross-functional teams to deliver high-quality solutions for data storage,...
-
Data Engineer
5 days ago
Singapore Unison Consulting Full timeWe are seeking a skilled and motivated Data Engineer with expertise in Hadoop, Spark, OpenShift Container Platform (OCP), and DevOps practices. As a Data Engineer, you will be responsible for designing, developing, and maintaining efficient data pipelines, processing large-scale datasets. Your expertise in Hadoop, Spark, OCP, and DevOps will be crucial in...
-
Refine Group | Spark Scala Developer
2 days ago
Singapore Refine Group Full timeWe are looking for a skilled Spark Scala Developer to join our dynamic team. The ideal candidate will have a deep understanding of big data technologies, particularly Apache Spark, and experience in Scala programming. You will be responsible for developing, optimizing, and maintaining our data processing pipelines, ensuring data integrity, performance, and...
-
Unison Consulting Pte Ltd | Business Analyst
2 days ago
Singapore Unison Consulting Pte Ltd Full timeAs a Business Analyst (Payments) at Unison Consulting Pte Ltd, you will play a crucial role in analyzing and optimizing payment systems, collaborating with stakeholders to identify requirements, and ensuring the delivery of innovative payment solutions. Your responsibilities will include: Gathering and documenting business requirements for payment...
-
Unison Consulting | Database Administrator
2 days ago
Singapore Unison Consulting Full timeAs a Database Administrator (DBA) at Unison Consulting Pte Ltd, you will play a crucial role in managing and maintaining our database systems. Your primary responsibilities will include designing, implementing, and optimizing database solutions to ensure high availability, security, and performance. You will work closely with development teams to support...
-
Big Data Engineer
2 days ago
Singapore HELIUS TECHNOLOGIES PTE. LTD. Full timeRoles & ResponsibilitiesBig Data EngineerJob Requirement: 5 years of hands on work experience in Hadoop, Scala, Pyspark and Python. Work with Hadoop Distributed File System (HDFS) to manage and store large datasets Utilize tools like Hive, HBase, and Pig to process data in Hadoop Set up and manage data pipelines to extract, transform, and load (ETL)...
-
Big Data Engineer
1 day ago
Singapore HELIUS TECHNOLOGIES PTE. LTD. Full timeRoles & ResponsibilitiesBig Data EngineerJob Requirement: 5 years of hands on work experience in Hadoop, Scala, Pyspark and Python. Work with Hadoop Distributed File System (HDFS) to manage and store large datasets Utilize tools like Hive, HBase, and Pig to process data in Hadoop Set up and manage data pipelines to extract, transform, and load (ETL)...
-
Singapore Unison Consulting Pte Ltd Full timeWe are looking for a detail-oriented and analytical Business Analyst specializing in Payment Frauds to join our team at Unison Consulting Pte Ltd. In this role, you will be responsible for analyzing and evaluating payment fraud incidents, identifying vulnerabilities in payment systems, and implementing solutions to enhance the security and integrity of...
-
Data Engineer
2 days ago
Singapore IT CONSULTANCY & SERVICES PTE LTD Full timeRoles & ResponsibilitiesKey Responsibilities Create complex, enterprise-transforming applications in high-energy, collaborative teams. Work with the latest tools and techniques in a hands-on coding environment, often utilizing pair programming. Build high-quality, maintainable code in a collaborative team environment. Demonstrate a solid understanding of...
-
Data Engineer
1 day ago
Singapore IT CONSULTANCY & SERVICES PTE LTD Full timeRoles & ResponsibilitiesKey Responsibilities Create complex, enterprise-transforming applications in high-energy, collaborative teams. Work with the latest tools and techniques in a hands-on coding environment, often utilizing pair programming. Build high-quality, maintainable code in a collaborative team environment. Demonstrate a solid understanding of...
-
Data Engineer
7 days ago
Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full timeRoles & ResponsibilitiesJob Summary:We are seeking a skilled and motivated Data Engineer with expertise in Scala, SQL, and Hadoop to join our dynamic team. In this role, you will design, develop, and maintain scalable data pipelines and systems to process large datasets. You will collaborate with cross-functional teams to deliver high-quality solutions for...
-
Data Engineer
7 days ago
Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full timeRoles & ResponsibilitiesJob Summary:We are seeking a skilled and motivated Data Engineer with expertise in Scala, SQL, and Hadoop to join our dynamic team. In this role, you will design, develop, and maintain scalable data pipelines and systems to process large datasets. You will collaborate with cross-functional teams to deliver high-quality solutions for...
-
Data Engineer
2 days ago
Singapore ONE NORTH CONSULTING PTE. LTD. Full timeRoles & ResponsibilitiesOne North Consulting is currently hiring Data Engineers with about 8+ years of experience as per details given below.Interested Singapore Citizens / Singapore Permanent Residents can connect on email id - Jit@OneNorthConsulting.comSkills & Responsibilities: -As Data Engineer, you will focus on managing the Hadoop cluster, implementing...
-
Data Engineer
1 day ago
Singapore ONE NORTH CONSULTING PTE. LTD. Full timeRoles & ResponsibilitiesOne North Consulting is currently hiring Data Engineers with about 8+ years of experience as per details given below.Interested Singapore Citizens / Singapore Permanent Residents can connect on email id - Jit@OneNorthConsulting.comSkills & Responsibilities: -As Data Engineer, you will focus on managing the Hadoop cluster, implementing...
-
Data Engineer
5 days ago
Singapore PERSOLKELLY SINGAPORE PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilities Design, build, and optimize scalable data pipelines using Scala and Hadoop frameworks. Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software. Write and optimize complex...
-
Data Engineer
5 days ago
Singapore PERSOLKELLY SINGAPORE PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilities Design, build, and optimize scalable data pipelines using Scala and Hadoop frameworks. Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software. Write and optimize complex...
-
Data Engineer
2 days ago
Singapore TECHNOPALS CONSULTANTS PTE. LTD. Full timeRoles & ResponsibilitiesBig Data Developer (3 – 10 Years) § Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust § Experience in designing application solutions in hadoop ecosystem § Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark § HDFS file...
-
Data Engineer
1 day ago
Singapore TECHNOPALS CONSULTANTS PTE. LTD. Full timeRoles & ResponsibilitiesBig Data Developer (3 – 10 Years) § Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust § Experience in designing application solutions in hadoop ecosystem § Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark § HDFS file...
-
Data Engineer
1 day ago
Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full timeRoles & ResponsibilitiesJob Summary:We are seeking a skilled and motivated Data Engineer with expertise in Scala, SQL, and Hadoop to join our dynamic team. In this role, design, develop, and maintain scalable data pipelines and systems to process large datasets. Collaborate with cross-functional teams to deliver high-quality solutions for data storage,...