ETL Developer Python/Hadoop

4 weeks ago

Singapore D L RESOURCES PTE LTD Full time
Roles & Responsibilities

Job Objectives

Potential candidate will support Anti Money Laundering Projects/CRs for Singapore and Regional entities. As an ETL Developer, the objective is to design, develop, and maintain efficient and scalable ETL processes to support data cleaning, integration, transformation, and loading operations. You will play a crucial role in ensuring the accuracy, reliability, and availability of data for analysis, reporting, and decision-making purposes.



Key Responsibilities

• Participate in end-to-end projects for system implementation of MLS system
• Engage and collaborate with Architects, Security and Development Lead to ensure solution design complies
with enterprise design principles, security, and control standards
• Liaise with application teams across group and countries build the enhancements according to the technical
solution plan
• Coordinate with Technology Delivery Manager and System Analyst to plan technical deliverables and
schedule, perform design and development works to meet project requirements, and produce technical
documents
• Escalate issues that impacts project schedule on timely basis and propose workarounds/resolutions
• Perform data profiling, cleansing, transformation and validation to ensure data quality and integrity throughout
the shell scripts and ETL pipelines
• Test, maintain and recommend software improvements to ensure strong functionality and optimization
• Create and maintain technical documentation, including ETL specifications, data mappings, data dictionary,
process workflows, data ownership and error handling procedures
• Implement project change request and in accordance with deployment schedule
• Partner with Test Management teams to ensure completion of SIT, UAT, performance / load testing and
application security testing with quality result
• Facilitate and provide technical and testing support before and after production deployment
• Collaborate with cross-functional teams, such as data scientists, analysts, and business users, to understand
their data requirements and provide support as needed
• Work with production support team members to conduct root cause analysis of issues, review new and
existing code and/or perform sanity testing and unit testing
• Liaise with other units across IT and Business in the organization
• Manage external vendors for project delivery within schedule


Key Requirements
Must Have
• Bachelor's degree in computer science, information technology, or a related field
• At least 8 years of experience and knowledge in Control M, Unix Shell Scripting, and SQL
• At least 8 years of experience and knowledge in deployment process, create, manage and maintain CICD
from source code repository, version control, code merge to deployment and housekeeping
• At least 6 years of experience in Hadoop, Hive, Hbase, HDFS and Data Engineering
• Experience in Bitbucket, Git, Jenkins, Artifactory and Aldon
• Experience in JIRA, Remedy and Incident Ticket management
• Ability to multitask effectively and handle large amounts of data
• Highly driven, pro-active and a strong team player
• Excellent interpersonal skills and written and verbal communication skills in English
Good to Have
• Experience in Python, Java, NoSQL
• Experience in System Interfaces (SFTP, FTP, Connect Direct, API, Rest)
• Experience in Confluence and SharePoint


Tell employers what skills you have

Technical Documentation
Application Security
Data Modeling
Hadoop Database
Anti Money Laundering
Unit Testing
Hadoop
ETL
Data Quality
Data Dictionary
Data Engineering
Apache Hadoop
SQL
SharePoint
HDFS
Python
Database Design
Hive
Unix Shell Scripting
SSIS

  • Data Engineer

    4 days ago

    Singapore HELIUS TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesFor quicker response, reach out at vijay@helius-tech.com or WA +65 92333815.Title: Data Engineer [ETL Developer] Required skills: ETL development and data pipeline management using Cloudera (Hadoop ecosystem), Talend, PostgreSQL, and SQL Server Experience with Talend, Python and Spark Experience in Database and Hadoop (Hive,...

  • Data Engineer

    4 days ago

    Singapore HELIUS TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesFor quicker response, reach out at vijay@helius-tech.com or WA +65 92333815.Title: Data Engineer [ETL Developer] Required skills: ETL development and data pipeline management using Cloudera (Hadoop ecosystem), Talend, PostgreSQL, and SQL Server Experience with Talend, Python and Spark Experience in Database and Hadoop (Hive,...

  • Senior ETL Test Lead

    4 weeks ago

    Singapore APAR TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesJob Responsibilities: Develop and execute QA strategies for Data Warehousing (DWH) and ETL projects in Agile environments. Create and maintain ETL test scripts using SQL or Python. Perform automated testing using tools like Query Surge or equivalent. Test and validate data on Snowflake, Hadoop, Teradata, and relational databases...

  • Senior ETL Test Lead

    4 weeks ago

    Singapore APAR TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesJob Responsibilities: Develop and execute QA strategies for Data Warehousing (DWH) and ETL projects in Agile environments. Create and maintain ETL test scripts using SQL or Python. Perform automated testing using tools like Query Surge or equivalent. Test and validate data on Snowflake, Hadoop, Teradata, and relational databases...

  • Software Engineer

    3 weeks ago

    Singapore MANPOWER STAFFING SERVICES (SINGAPORE) PTE LTD Full time

    Roles & ResponsibilitiesWe are seeking for a new talent to join the software engineering team where you will have the opportunity to collaborate in the project, using the Talend ETL toolset, to create new and maintain existing ETL jobs. Design and implement ETL for extracting and transforming data from diverse sources, such as: Cloudera, PostgreSQL, and SQL...

  • Software Engineer

    3 weeks ago

    Singapore MANPOWER STAFFING SERVICES (SINGAPORE) PTE LTD Full time

    Roles & ResponsibilitiesWe are seeking for a new talent to join the software engineering team where you will have the opportunity to collaborate in the project, using the Talend ETL toolset, to create new and maintain existing ETL jobs. Design and implement ETL for extracting and transforming data from diverse sources, such as: Cloudera, PostgreSQL, and SQL...

  • Data Engineer

    5 days ago

    Singapore JONDAVIDSON PTE. LTD. Full time

    Roles & ResponsibilitiesData Engineer (Python, Java or Scala)Seeking a talented Data Engineer to join the team. In this role, you will be responsible for designing, building, and maintaining data pipelines to support data analytics and business intelligence initiatives. Will collaborate with cross-functional teams to develop efficient data pipelines and...

  • Data Engineer

    5 days ago

    Singapore JONDAVIDSON PTE. LTD. Full time

    Roles & ResponsibilitiesData Engineer (Python, Java or Scala)Seeking a talented Data Engineer to join the team. In this role, you will be responsible for designing, building, and maintaining data pipelines to support data analytics and business intelligence initiatives. Will collaborate with cross-functional teams to develop efficient data pipelines and...

  • Senior ETL Consultant

    5 days ago

    Singapore Tata Consultancy Services Full time

    Job Responsibilities At least 10+ years of quality assurance experience with exposure/experience in Agile Development environments for DWH/ETL Projects. Experience with Query Surge automated testing tools or equivalent automation skills. Can write ETL Testing scripts (using SQL/Python). Deep knowledge of Data Warehousing concepts, ETL Process, and cloud...

  • Senior ETL Specialist

    5 days ago

    Singapore Tata Consultancy Services Full time

    Company OverviewAt Tata Consultancy Services, we are committed to delivering innovative solutions that meet the evolving needs of our clients. Our team of experts is dedicated to providing top-notch services that drive business growth and success.Job DescriptionAs a Senior ETL Consultant, you will play a critical role in ensuring the successful...

  • ETL Developer

    4 days ago

    Singapore BEYONDSOFT INTERNATIONAL (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesRole Responsibilities:- System analysis to develop/ maintain/ modify application based on requirement Error handling and user support for any inquire Gathering user requirements, defining system functionality, and writing code Create and modify Database Table/View/Function etc. Maintain and develop report in Tableau Develop and...

  • ETL Developer

    4 days ago

    Singapore BEYONDSOFT INTERNATIONAL (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesRole Responsibilities:- System analysis to develop/ maintain/ modify application based on requirement Error handling and user support for any inquire Gathering user requirements, defining system functionality, and writing code Create and modify Database Table/View/Function etc. Maintain and develop report in Tableau Develop and...

  • Senior ETL Developer

    6 days ago

    Singapore Infosys Singapore & Australia Full time

    Infosys Consulting is a global management consulting firm that helps its clients transform and innovate. We are looking for a senior ETL developer to join our data engineering team.The successful candidate will have 2-5 years of experience in data processing and ETL using SQL, Informatica, AWS Glue, Airflow, Python or similar tools. They will be responsible...

  • ETL Development Specialist

    5 days ago

    Singapore Infosys Singapore & Australia Full time

    We are seeking an ETL Development Specialist to join our team at Infosys Singapore & Australia. As an ETL Development Specialist, you will be responsible for designing and developing ETL workflows to move data from various sources into the organization's data warehouse.You will work closely with cross-functional teams to ensure data solutions meet business...

  • ETL Engineer

    4 weeks ago

    Singapore FLINTEX CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesObjectives of this position:The objective of the position is to manage the extract/transform/load processes ensuring the data availability. Responsibilities:The holder of the position is mainly responsible for the following areas in coordination with his / her superior:•Design, create, modify extract/transform/load (ETL) pipelines...

  • ETL Engineer

    3 weeks ago

    Singapore FLINTEX CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesObjectives of this position:The objective of the position is to manage the extract/transform/load processes ensuring the data availability. Responsibilities:The holder of the position is mainly responsible for the following areas in coordination with his / her superior:•Design, create, modify extract/transform/load (ETL) pipelines...

  • ETL Engineer

    3 weeks ago

    Singapore FLINTEX CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesObjectives of this position:The objective of the position is to manage the extract/transform/load processes ensuring the data availability. Responsibilities:The holder of the position is mainly responsible for the following areas in coordination with his / her superior:•Design, create, modify extract/transform/load (ETL) pipelines...

  • ETL Engineer

    4 weeks ago

    Singapore FLINTEX CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesObjectives of this position:The objective of the position is to manage the extract/transform/load processes ensuring the data availability. Responsibilities:The holder of the position is mainly responsible for the following areas in coordination with his / her superior:•Design, create, modify extract/transform/load (ETL) pipelines...

  • Hadoop Admin

    4 days ago

    Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesRole: Contract (1 year, Renewable)Experience: 5 - 6 yearsMandatory Skills: Bigdata, Hadoop, Unix, Cloudera Manager, and HDFSPOSITION GENERAL DUTIES AND TASKS: possesses experience in Big Data Hadoop and Unix, along with the following responsibilities. Implementing, managing, and administering the overall Hadoop infrastructure. ...

  • Hadoop Admin

    4 days ago

    Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesRole: Contract (1 year, Renewable)Experience: 5 - 6 yearsMandatory Skills: Bigdata, Hadoop, Unix, Cloudera Manager, and HDFSPOSITION GENERAL DUTIES AND TASKS: possesses experience in Big Data Hadoop and Unix, along with the following responsibilities. Implementing, managing, and administering the overall Hadoop infrastructure. ...