Etl Engineer

4 days ago


Singapore ANTAS PTE. LTD. Full time

In depth knowledge of Testing methodologies, concepts, phases, and types of testing, developing Test Plans, Test Scenarios, Test Cases, Test Procedures, Test Reports and documenting test results accordingly after analyzing Business Requirements Documents (BRD), Functional Requirement Specifications (FRS).
Well versed in ETL, Hadoop ecosystem - Map Reduce, Pig, Hive, HBase, Oozie and Sqoop.
Expert in writing complex SQL Queries to check the integrity of data to perform database testing.
Experience in Data Analysis, Data Validation, Data Cleansing, Data Verification and identifying data mismatch.
Experience in importing and exporting data from relational database into Hadoop cluster using sqoop.
Experienced in creating Hive, Pig and custom map reduce programs for analyzing data.
Experience in validating and analyzing Hadoop log files.
Experience in loading multiple larger datasets into HDFS and processing the datasets by using the Hive and Pig.
Experience in validating tables with Partitions, bucketing and Loading data into HIVE tables.
Strong Experience writing Hive Queries for analyzing data in Hive warehouse using Hive Query Language (HQL).
Experience in writing and executing Test Plans and Test Cases from Requirements and Design documents.
Experience on UNIX commands and Shell Scripting
Very good understanding of Data Warehousing concepts, Data Analysis, Data Warehouse Architecture and Designing.
Should have Understanding of Data Models, Data Schema, ETL and created extensive store procedures, SQL queries to perform back-end data warehousing testing.
Experienced in Bug Reporting and Defect tracking using tools like Rational ClearQuest, HP Quality Center and Test Director to log and defect management.
Experienced in interacting with Clients, Business Analysts, leads, and UAT Users.
ETL Tools: Informatica Power Center, Ab Initio, Data Stage, SSIS ( optional )

Big Data Technology: HDFS, Hive, Pig, HBase, Sqoop, Oozie, ZooKeeper, Cassandra


  • ETL Engineer

    3 weeks ago


    Singapore FLINTEX CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesObjectives of this position:The objective of the position is to manage the extract/transform/load processes ensuring the data availability.Responsibilities:The holder of the position is mainly responsible for the following areas in coordination with his / her superior:•Design, create, modify extract/transform/load (ETL) pipelines in...

  • ETL Engineer

    1 week ago


    Singapore FLINTEX CONSULTING PTE. LTD. Full time

    Objectives of this position: The objective of the position is to manage the extract/transform/load processes ensuring the data availability. Responsibilities: The holder of the position is mainly responsible for the following areas in coordination with his / her superior: •Design, create, modify extract/transform/load (sETL) pipelines in Azure Data...

  • Etl & Data Engineer

    1 week ago


    Singapore SAGL CONSULTING PTE. LTD. Full time

    **Role Overview**: ETL & Data Engineer to design, build, and maintain robust data pipelines and backend services that power AI-driven operations. The role involves working with high-volume IT and cloud data, optimizing ETL processes, and integrating with AIOps platforms and ML pipelines. **Key Responsibilities**: - Build and maintain scalable ETL pipelines...

  • ETL & Data Engineer

    1 week ago


    Singapore SAGL CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesRole Overview:ETL & Data Engineer to design, build, and maintain robust data pipelines and backend services that power AI-driven operations. The role involves working with high-volume IT and cloud data, optimizing ETL processes, and integrating with AIOps platforms and ML pipelines.Key Responsibilities:Build and maintain scalable ETL...

  • ETL & Data Engineer

    4 days ago


    Singapore Sagl Consulting Full time

    Role Overview: ETL & Data Engineer to design, build, and maintain robust data pipelines and backend services that power AI-driven operations. The role involves working with high-volume IT and cloud data, optimizing ETL processes, and integrating with AIOps platforms and ML pipelines. Key Responsibilities: Build and maintain scalable ETL pipelines for...

  • ETL & Data Engineer

    7 days ago


    Singapore Sagl Consulting Full time $120,000 - $150,000 per year

    Role Overview:ETL & Data Engineer to design, build, and maintain robust data pipelines and backend services that power AI-driven operations. The role involves working with high-volume IT and cloud data, optimizing ETL processes, and integrating with AIOps platforms and ML pipelines.Key Responsibilities:Build and maintain scalable ETL pipelines for batch and...

  • ETL & Data Engineer

    4 days ago


    Singapore SAGL CONSULTING PTE. LTD. Full time

    Role Overview ETL & Data Engineer to design, build, and maintain robust data pipelines and backend services that power AI-driven operations. The role involves working with high-volume IT and cloud data, optimizing ETL processes, and integrating with AIOps platforms and ML pipelines. Key Responsibilities Build and maintain scalable ETL pipelines for...

  • ETL & Data Engineer

    6 days ago


    Singapore SAGL CONSULTING PTE. LTD. Full time

    Role Overview: ETL & Data Engineer to design, build, and maintain robust data pipelines and backend services that power AI-driven operations. The role involves working with high-volume IT and cloud data, optimizing ETL processes, and integrating with AIOps platforms and ML pipelines.Key Responsibilities: Build and maintain scalable ETL pipelines for batch...

  • Etl Dag Engineers

    4 days ago


    Singapore RESOURCE HUNT PTE. LTD. Full time

    **ETL DAG Engineers - Onsite** - Prepare DAG - Prepare Airflow based ETL Jobs - Document architecture & technical design - Analyze and implement Securities Services use case - Implement required Securities for product data acquisition Basic knowledge of Python, installing packages, and virtual environment.


  • Central Singapore Emprego SG Full time

    **Location** - Singapore, Central Singapore**Job Type** - Permanent**Salary** - $8,000 - $11,000 Per Month**Date Posted** - 2 hours agoAdditional Details **Job ID** - 107514**Job Views** - 1Roles & Responsibilities **Company Description** Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers,...