Data Pipeline Engineer with Hadoop Experience
7 days ago
We are seeking an experienced Data Pipeline Engineer to join our team at MATRIX PROCESS AUTOMATION PTE. LTD..
The successful candidate will have a strong background in designing and implementing high-throughput, fault-tolerant data pipelines for batch processing using ETL/ELT methodologies.
In this role, you will work closely with our team to develop and maintain complex data pipelines using Teradata tools and technologies, as well as experience with Hadoop tool sets such as Hive, Hue, Spark, and Kafka.
A key focus of the position is to ensure that data is accurately processed, transformed, and loaded into our systems in a timely and efficient manner.
This includes:
- Designing and implementing data pipelines that meet business requirements and adhere to industry best practices
- Developing and maintaining high-quality, performant code in languages such as SQL and UNIX
- Collaborating with cross-functional teams to identify opportunities for process improvements and implement changes
Requirements
To be considered for this role, you must have:
- At least 3+ years of relevant experience in the banking/financial services industry
- Hands-on experience with Teradata FSLDM and data mapping
- Strong skills in SQL, UNIX, and Teradata tools and technologies
- Experience in designing high-throughput, fault-tolerant data pipelines for batch processing (ETL/ELT)
- Knowledge of GL Data reconciliation between systems, datamarts, and reports
Desirable Skills
A plus would be experience in performance tuning on Teradata or other MPP data pipeline and hands-on experience within the Hadoop tool sets (Hive, Hue, Spark, Kafka).
Estimated Salary: SGD 8,000 - SGD 12,000 per month.
We offer a competitive salary and benefits package, including medical insurance, annual leave, and opportunities for professional growth and development.
-
Data Engineer
4 weeks ago
Singapore PERSOLKELLY SINGAPORE PTE. LTD. Full timeRoles & ResponsibilitiesJOB DESCRIPTIONJob TitleData Engineer (Bigdata, Hadoop)OccupationDATA ENGINEERJob Description & RequirementsAbout the Client:Our client is a local bank in SingaporeResponsibilities: Design and implement scalable data pipelines to collect, process, and store data from various sources. Write, optimize, and maintain complex SQL queries...
-
Senior Hadoop Engineer
1 month ago
Singapore ITCAN Full timeAbout the Role:We are seeking a highly skilled Senior Hadoop Engineer to join our team at ITCAN. The successful candidate will have 10+ years of experience in software engineering, with 3+ years specifically in the Hadoop ecosystem. Key responsibilities will include owning multiple critical applications on big data platforms, with experience in batch and...
-
Senior Hadoop Engineer
7 days ago
Singapore ATOS INFORMATION TECHNOLOGY (SINGAPORE) PTE. LTD. Full timeAre you a seasoned Hadoop expert looking for a challenging role in Big Data Engineering? Do you have a strong background in Hadoop Hortonworks administration and support, as well as expertise in Cloudera Data Platform admin?We are seeking a talented Senior Hadoop Engineer to join our team at ATOS INFORMATION TECHNOLOGY (SINGAPORE) PTE. LTD. As a key member...
-
Data Engineer with Hadoop Experience
22 hours ago
Singapore D L RESOURCES PTE LTD Full timeJob OverviewD L Resources PTE LTD is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining efficient and scalable ETL processes to support data cleaning, integration, transformation, and loading operations.ResponsibilitiesDesign and develop end-to-end ETL processes...
-
Data Pipeline Architect
5 days ago
Singapore MATRIX PROCESS AUTOMATION PTE. LTD. Full timeJob DescriptionAt MATRIX PROCESS AUTOMATION PTE. LTD., we are seeking a highly skilled Data Pipeline Architect to join our team. This role is crucial in designing and implementing high-throughput, fault-tolerant data pipelines for batch processing (ETL/ELT) and data reconciliation between systems.About the RoleDesign and develop complex data pipelines using...
-
Singapore Unison Consulting Pte Ltd Full timeAt Unison Consulting Pte Ltd, we are seeking an experienced Big Data Engineer to join our team. The successful candidate will have a strong background in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.The role involves collaborating with cross-functional teams to build scalable and efficient data...
-
Software Developer
2 days ago
Singapore Capgemini Full timeRole Overview:We are looking for a Software Developer with experience in Hadoop, Spark, and cloud platforms. You will be responsible for building and optimizing data pipelines, working with relational and NoSQL databases, and deploying data applications to cloud environments. The role requires a passion for data engineering and an interest in developing both...
-
Data Scientist
3 weeks ago
Singapore Unison Consulting Pte Ltd Full timeAbout This RoleWe are seeking a highly skilled Data Scientist (Hadoop, Spark, Scala) to join our team at Unison Consulting Pte Ltd. The ideal candidate will have extensive experience with big data processing, Hadoop, Spark, and Scala.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines and ETL processes using Hadoop and Spark.Write...
-
Hadoop Cloud Engineer
3 days ago
Singapore ATOS INFORMATION TECHNOLOGY (SINGAPORE) PTE. LTD. Full timeAbout UsATOS INFORMATION TECHNOLOGY (SINGAPORE) PTE. LTD. is a leading IT solutions provider.SalaryThe estimated salary for this position is SGD 120,000 - 180,000 per annum, depending on experience.Job DescriptionHadoop Expert RequiredWe are seeking an experienced Hadoop engineer to join our team as a Hadoop cloud engineer. The successful candidate will be...
-
Data Engineer
4 weeks ago
Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full timeRoles & ResponsibilitiesRole: Contract (1 year, Renewable)Position: Big Data Support EngineerMandatory Skills: Big Data, Data pipeline, Apache and HadoopExperience: 4 - 6 yrsPOSITION GENERAL DUTIES AND TASKS:- Strong in data engineering concepts and programming- Experience in building and optimizing ‘big data’ data pipelines, architectures and data...
-
Singapore UMILIFE (SINGAPORE) PTE. LTD. Full timeWe are seeking a highly skilled Data Engineer to join our team at UMILIFE (SINGAPORE) PTE. LTD.About the Role:As a Data Engineer, you will be responsible for designing, developing, and optimizing large-scale data pipelines to efficiently collect, process, and store data. You will work closely with data teams to meet data requirements and communicate complex...
-
Big Data Engineer: Scaling Hadoop Infrastructure
3 hours ago
Singapore ATOS INFORMATION TECHNOLOGY (SINGAPORE) PTE. LTD. Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team in Singapore. As a key member of our data engineering group, you will be responsible for designing and implementing large-scale Hadoop infrastructure platforms.ResponsibilitiesEngage with customers to provide technological solutions and operational improvement recommendations for...
-
Data Engineering Expert
3 weeks ago
Singapore Centre for Strategic Infocomm Technologies Full timeAbout This RoleWe are seeking a seasoned Data Engineer to join our Data & Systems Engineering team at the Centre for Strategic Infocomm Technologies. As a key member of this team, you will be responsible for designing and implementing cutting-edge data products, collaborating closely with cross-functional teams to gather requirements and develop scalable...
-
Data Engineer
1 month ago
Singapore NEURONES IT ASIA PTE. LTD. Full timeRoles & ResponsibilitiesAs a Data Engineer, Your main responsibilities will include: Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data. Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data. Optimize and tune Spark...
-
Big Data Engineer
4 weeks ago
Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full timeRoles & ResponsibilitiesRole: Contract (1 year, Renewable)Position: Big Data Support EngineerMandatory Skills: Big Data, Data pipeline, Apache and HadoopExperience: 6 - 8 yrsPOSITION GENERAL DUTIES AND TASKS:- Strong in data engineering concepts and programming- Experience in building and optimizing ‘big data’ data pipelines, architectures and data...
-
Data Engineer
1 month ago
Singapore EXASOFT PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilities• Join the data migration project, including transitioning legacy systems to more modernsystem• Design, build, and maintain data pipelines to enable seamless data extraction,transformation, and loading (ETL) while ensuring high data quality throughout theprocess.• Identify and resolve data quality issues by...
-
Data Engineer
7 days ago
Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full timeRoles & ResponsibilitiesRole: Contract (1 year, Renewable)Mandatory Skills: Big Data, Data pipeline, Apache and HadoopExperience: 6 - 8 yrsPOSITION GENERAL DUTIES AND TASKS:- Strong in data engineering concepts and programming- Experience in building and optimizing ‘big data’ data pipelines, architectures and data sets.- Experience performing root cause...
-
Senior Data Engineer
3 days ago
Singapore D L RESOURCES PTE LTD Full timeAbout the RoleWe are seeking a highly skilled Senior Data Engineer with expertise in Hadoop and Python to join our team at D L Resources PTE LTD. As a key member of our data engineering team, you will play a crucial role in designing, developing, and maintaining efficient and scalable ETL processes to support data cleaning, integration, transformation, and...
-
Data Engineer
1 month ago
Singapore APBA TG HUMAN RESOURCE PTE. LTD. Full timeRoles & ResponsibilitiesData Engineer Design, develop, and maintain scalable data pipelines using Hadoop, Apache Spark, and related Big Data technologies. Implement ETL (Extract, Transform, Load) processes to manage large-scale data from various sources. Collaborate with cross-functional teams to define data architecture, data models, and...
-
Data Engineer
1 month ago
Singapore SYNECHRON TECHNOLOGIES SINGAPORE PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilities:· Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives· Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions· Ensure data quality and integrity...