Data Pipeline Engineer with Hadoop Experience

7 days ago


Singapore MATRIX PROCESS AUTOMATION PTE. LTD. Full time
Job Description

We are seeking an experienced Data Pipeline Engineer to join our team at MATRIX PROCESS AUTOMATION PTE. LTD..

The successful candidate will have a strong background in designing and implementing high-throughput, fault-tolerant data pipelines for batch processing using ETL/ELT methodologies.

In this role, you will work closely with our team to develop and maintain complex data pipelines using Teradata tools and technologies, as well as experience with Hadoop tool sets such as Hive, Hue, Spark, and Kafka.

A key focus of the position is to ensure that data is accurately processed, transformed, and loaded into our systems in a timely and efficient manner.

This includes:
  • Designing and implementing data pipelines that meet business requirements and adhere to industry best practices
  • Developing and maintaining high-quality, performant code in languages such as SQL and UNIX
  • Collaborating with cross-functional teams to identify opportunities for process improvements and implement changes

Requirements

To be considered for this role, you must have:
  • At least 3+ years of relevant experience in the banking/financial services industry
  • Hands-on experience with Teradata FSLDM and data mapping
  • Strong skills in SQL, UNIX, and Teradata tools and technologies
  • Experience in designing high-throughput, fault-tolerant data pipelines for batch processing (ETL/ELT)
  • Knowledge of GL Data reconciliation between systems, datamarts, and reports

Desirable Skills

A plus would be experience in performance tuning on Teradata or other MPP data pipeline and hands-on experience within the Hadoop tool sets (Hive, Hue, Spark, Kafka).

Estimated Salary: SGD 8,000 - SGD 12,000 per month.

We offer a competitive salary and benefits package, including medical insurance, annual leave, and opportunities for professional growth and development.
  • Data Engineer

    4 weeks ago


    Singapore PERSOLKELLY SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesJOB DESCRIPTIONJob TitleData Engineer (Bigdata, Hadoop)OccupationDATA ENGINEERJob Description & RequirementsAbout the Client:Our client is a local bank in SingaporeResponsibilities: Design and implement scalable data pipelines to collect, process, and store data from various sources. Write, optimize, and maintain complex SQL queries...


  • Singapore ITCAN Full time

    About the Role:We are seeking a highly skilled Senior Hadoop Engineer to join our team at ITCAN. The successful candidate will have 10+ years of experience in software engineering, with 3+ years specifically in the Hadoop ecosystem. Key responsibilities will include owning multiple critical applications on big data platforms, with experience in batch and...


  • Singapore ATOS INFORMATION TECHNOLOGY (SINGAPORE) PTE. LTD. Full time

    Are you a seasoned Hadoop expert looking for a challenging role in Big Data Engineering? Do you have a strong background in Hadoop Hortonworks administration and support, as well as expertise in Cloudera Data Platform admin?We are seeking a talented Senior Hadoop Engineer to join our team at ATOS INFORMATION TECHNOLOGY (SINGAPORE) PTE. LTD. As a key member...


  • Singapore D L RESOURCES PTE LTD Full time

    Job OverviewD L Resources PTE LTD is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining efficient and scalable ETL processes to support data cleaning, integration, transformation, and loading operations.ResponsibilitiesDesign and develop end-to-end ETL processes...


  • Singapore MATRIX PROCESS AUTOMATION PTE. LTD. Full time

    Job DescriptionAt MATRIX PROCESS AUTOMATION PTE. LTD., we are seeking a highly skilled Data Pipeline Architect to join our team. This role is crucial in designing and implementing high-throughput, fault-tolerant data pipelines for batch processing (ETL/ELT) and data reconciliation between systems.About the RoleDesign and develop complex data pipelines using...


  • Singapore Unison Consulting Pte Ltd Full time

    At Unison Consulting Pte Ltd, we are seeking an experienced Big Data Engineer to join our team. The successful candidate will have a strong background in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.The role involves collaborating with cross-functional teams to build scalable and efficient data...

  • Software Developer

    2 days ago


    Singapore Capgemini Full time

    Role Overview:We are looking for a Software Developer with experience in Hadoop, Spark, and cloud platforms. You will be responsible for building and optimizing data pipelines, working with relational and NoSQL databases, and deploying data applications to cloud environments. The role requires a passion for data engineering and an interest in developing both...

  • Data Scientist

    3 weeks ago


    Singapore Unison Consulting Pte Ltd Full time

    About This RoleWe are seeking a highly skilled Data Scientist (Hadoop, Spark, Scala) to join our team at Unison Consulting Pte Ltd. The ideal candidate will have extensive experience with big data processing, Hadoop, Spark, and Scala.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines and ETL processes using Hadoop and Spark.Write...


  • Singapore ATOS INFORMATION TECHNOLOGY (SINGAPORE) PTE. LTD. Full time

    About UsATOS INFORMATION TECHNOLOGY (SINGAPORE) PTE. LTD. is a leading IT solutions provider.SalaryThe estimated salary for this position is SGD 120,000 - 180,000 per annum, depending on experience.Job DescriptionHadoop Expert RequiredWe are seeking an experienced Hadoop engineer to join our team as a Hadoop cloud engineer. The successful candidate will be...

  • Data Engineer

    4 weeks ago


    Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesRole: Contract (1 year, Renewable)Position: Big Data Support EngineerMandatory Skills: Big Data, Data pipeline, Apache and HadoopExperience: 4 - 6 yrsPOSITION GENERAL DUTIES AND TASKS:- Strong in data engineering concepts and programming- Experience in building and optimizing ‘big data’ data pipelines, architectures and data...


  • Singapore UMILIFE (SINGAPORE) PTE. LTD. Full time

    We are seeking a highly skilled Data Engineer to join our team at UMILIFE (SINGAPORE) PTE. LTD.About the Role:As a Data Engineer, you will be responsible for designing, developing, and optimizing large-scale data pipelines to efficiently collect, process, and store data. You will work closely with data teams to meet data requirements and communicate complex...


  • Singapore ATOS INFORMATION TECHNOLOGY (SINGAPORE) PTE. LTD. Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team in Singapore. As a key member of our data engineering group, you will be responsible for designing and implementing large-scale Hadoop infrastructure platforms.ResponsibilitiesEngage with customers to provide technological solutions and operational improvement recommendations for...


  • Singapore Centre for Strategic Infocomm Technologies Full time

    About This RoleWe are seeking a seasoned Data Engineer to join our Data & Systems Engineering team at the Centre for Strategic Infocomm Technologies. As a key member of this team, you will be responsible for designing and implementing cutting-edge data products, collaborating closely with cross-functional teams to gather requirements and develop scalable...

  • Data Engineer

    1 month ago


    Singapore NEURONES IT ASIA PTE. LTD. Full time

    Roles & ResponsibilitiesAs a Data Engineer, Your main responsibilities will include: Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data. Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data. Optimize and tune Spark...

  • Big Data Engineer

    4 weeks ago


    Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesRole: Contract (1 year, Renewable)Position: Big Data Support EngineerMandatory Skills: Big Data, Data pipeline, Apache and HadoopExperience: 6 - 8 yrsPOSITION GENERAL DUTIES AND TASKS:- Strong in data engineering concepts and programming- Experience in building and optimizing ‘big data’ data pipelines, architectures and data...

  • Data Engineer

    1 month ago


    Singapore EXASOFT PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities• Join the data migration project, including transitioning legacy systems to more modernsystem• Design, build, and maintain data pipelines to enable seamless data extraction,transformation, and loading (ETL) while ensuring high data quality throughout theprocess.• Identify and resolve data quality issues by...

  • Data Engineer

    7 days ago


    Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesRole: Contract (1 year, Renewable)Mandatory Skills: Big Data, Data pipeline, Apache and HadoopExperience: 6 - 8 yrsPOSITION GENERAL DUTIES AND TASKS:- Strong in data engineering concepts and programming- Experience in building and optimizing ‘big data’ data pipelines, architectures and data sets.- Experience performing root cause...


  • Singapore D L RESOURCES PTE LTD Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer with expertise in Hadoop and Python to join our team at D L Resources PTE LTD. As a key member of our data engineering team, you will play a crucial role in designing, developing, and maintaining efficient and scalable ETL processes to support data cleaning, integration, transformation, and...

  • Data Engineer

    1 month ago


    Singapore APBA TG HUMAN RESOURCE PTE. LTD. Full time

    Roles & ResponsibilitiesData Engineer Design, develop, and maintain scalable data pipelines using Hadoop, Apache Spark, and related Big Data technologies. Implement ETL (Extract, Transform, Load) processes to manage large-scale data from various sources. Collaborate with cross-functional teams to define data architecture, data models, and...

  • Data Engineer

    1 month ago


    Singapore SYNECHRON TECHNOLOGIES SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities:· Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives· Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions· Ensure data quality and integrity...