Senior ETL Developer with Big Data Expertise
3 weeks ago
We are seeking a highly skilled Senior ETL Developer to join our team at ELLIOTT MOSS CONSULTING PTE. LTD. The ideal candidate will possess strong proficiency in ETL solutions such as Informatica BDM, experience with big data technologies like Cloudera, and advanced knowledge of programming languages such as Python, Scala, and Java.
Key Responsibilities:
- Develop, optimize, and manage ETL workflows using Informatica BDM to transform and process large datasets.
- Maintain and manage big data environments, particularly on platforms like Cloudera.
- Design and implement scalable data processing frameworks using tools such as Apache Spark.
- Write and maintain complex Unix Shell scripts for automation and data manipulation tasks.
- Provide infrastructure management and administration support for Cloudera Admin and Informatica Admin.
- Collaborate with cross-functional teams to design, develop, and deploy data solutions.
- Conduct data quality checks to ensure accuracy and consistency in all data processing activities.
- Participate in code reviews, optimization, and performance tuning of data processing jobs.
- Troubleshoot and resolve any issues related to ETL processes and data pipelines.
- Mentor and guide junior developers in best practices for ETL development, data integration, and automation.
- Ensure adherence to project timelines while managing multiple priorities in a dynamic environment.
Requirements:
- 5+ years of experience with ETL solutions such as Informatica BDM.
- Proven expertise in big data platforms, especially Cloudera.
- Strong knowledge of data processing frameworks such as Apache Spark.
- Proficiency in programming languages such as Python, Scala, and Java.
- Solid experience in Unix Shell scripting.
- Demonstrated problem-solving skills with a high level of accuracy and attention to detail.
- Strong ability to work independently while managing multiple tasks in a fast-paced environment.
- Demonstrated excellence in mentoring and team collaboration.
- Excellent written and verbal communication skills.
-
Senior Big Data Engineer
1 month ago
Singapore NTT Data Singapore Full timeRequirements We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. The ideal candidate will have a Bachelor's degree in Computer Science or a related field and at least 7 years of IT experience, with a minimum of 5 years in a similar role. Proficiency in distributed computing principles and strong experience with Hadoop,...
-
Senior ETL Data Architect
1 week ago
Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full timeJob OverviewWe are seeking an experienced Senior ETL Data Architect to join our team at ELLIOTT MOSS CONSULTING PTE. LTD.This role involves managing and optimizing large-scale data infrastructure, working independently in dynamic environments, and mentoring junior team members.Job SummaryAs a Senior ETL Data Architect, you will be responsible for designing,...
-
Senior Big Data Engineer
4 weeks ago
Singapore NTT Data Singapore Full timeJob Requirements We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. The ideal candidate will have a Bachelor's degree in Computer Science or a related field and at least 7 years of IT experience, with a minimum of 5 years in a similar role. Key Responsibilities • Proficient understanding of distributed computing...
-
Data Engineer
3 weeks ago
Singapore PERSOLKELLY SINGAPORE PTE. LTD. Full timeAbout the RoleAt PERSOLKELLY SINGAPORE PTE. LTD., we seek a skilled ETL Developer to join our team. As an ETL Developer, you will play a key role in designing, developing, and maintaining scalable ETL pipelines to move and transform data from disparate sources to target systems. Your expertise in Talend and YugabyteDB is highly valued in this position. If...
-
Senior ETL Developer
3 weeks ago
Singapore Unison Consulting Pte Ltd Full timeJob Title: Senior ETL DeveloperJob Summary: We are seeking an experienced Senior ETL Developer to join our team at Unison Consulting Pte Ltd. The successful candidate will be responsible for designing, developing, and implementing complex ETL processes using Informatica PowerCenter.Key Responsibilities:Design and develop high-quality ETL mappings, workflows,...
-
Singapore THEE BIRAPANJAA SYSTEMS (PTE. LTD.) Full timeJob OverviewThe role of a Data Engineer is a pivotal position within THEE BIRAPANJAA SYSTEMS (PTE. LTD.) that involves designing, developing, and maintaining large-scale data systems. As an expert in ETL (Extract, Transform, Load) processes, the successful candidate will have extensive knowledge of data extraction, transformation, and loading. This includes...
-
Scala Developer with Big Data Expertise
1 week ago
Singapore KRIS INFOTECH PTE. LTD. Full timeAt KRIS INFOTECH PTE. LTD., we are seeking an experienced Scala developer to join our team.Job SummaryWe are looking for a highly skilled Scala developer with expertise in big data processing using Spark and Hadoop.About the RoleThis is a challenging opportunity to work on large-scale data processing projects using Scala, PySpark, and Hive.We require someone...
-
ETL Developer
4 weeks ago
Singapore PERSOLKELLY SINGAPORE PTE. LTD. Full timeRoles & ResponsibilitiesJOB DESCRIPTIONJob TitleETL Developer (Talend & YugabyteDB Expertise)OccupationDATA ENGINEERJob Description & RequirementsAbout the Client:Our client is a highly reputed and well-established organization within the insurance industry.Responsibilities: Design, develop, and maintain scalable ETL pipelines to move and transform data...
-
Big Data Developer
4 weeks ago
Singapore PRIMESTAFF MANAGEMENT SERVICES PTE LTD Full timeRoles & ResponsibilitiesOur client is looking for an experienced and highly skilled Senior Big Data Developer to join the dynamic team. The ideal candidate will have over 10 years of extensive working knowledge and hands-on expertise in big data technologies, especially in Spark on Scala or PySpark, and Hive. This role will involve the design, development,...
-
Data ETL Engineer
2 weeks ago
Singapore MANPOWER STAFFING SERVICES (SINGAPORE) PTE LTD Full timeRoles & ResponsibilitiesResponsibilities:The holder of the position is mainly responsible for the following areas in coordination with his / her superior:• Design, create, modify extract/transform/load (ETL) pipelines in Azure Data Factory ensuring efficient data flow from source to destination.• Ensure data accuracy and data integrity throughout the ETL...
-
Big Data Engineer
1 week ago
Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full timeRoles & ResponsibilitiesRole: Contract (1 year, Renewable)Position: Big Data Support EngineerMandatory Skills: Big Data, Data pipeline, Apache and HadoopExperience: 6 - 8 yrsPOSITION GENERAL DUTIES AND TASKS:- Strong in data engineering concepts and programming- Experience in building and optimizing ‘big data’ data pipelines, architectures and data...
-
Big Data Engineering Specialist
4 days ago
Singapore Unison Consulting Pte Ltd Full timeAbout UsUnison Consulting Pte Ltd is a leading consulting firm that specializes in data engineering solutions.We are seeking a highly skilled Big Data Engineering Specialist to join our team.Job DescriptionJob Title: Big Data Engineering SpecialistEstimated Salary: $120,000 - $180,000 per annumAs a Big Data Engineering Specialist at Unison Consulting Pte...
-
Informatica Developer
4 weeks ago
Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full timeRoles & ResponsibilitiesJob Summary:We are looking for a highly skilled and experienced Senior ETL Developer with expertise in big data platforms and data processing frameworks. The successful candidate will have strong proficiency in ETL solutions such as Informatica BDM, experience with big data technologies like Cloudera, and advanced knowledge of...
-
Data Engineer for Big Data Migration
5 days ago
Singapore U3 Full timeAbout the RoleWe are seeking an experienced Data Engineer to join our team at U3 Infotech. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines and data services modules with robustness in mind to support the growing demands from business users.Key ResponsibilitiesDesign and implement...
-
Big Data Engineer with AI Expertise
3 weeks ago
Singapore CORPORATE IT SOLUTIONS PTE. LTD. Full timeUnlock the Power of Big Data with Corporate IT Solutions PTE. LTD.We are seeking a highly skilled Senior Cloud Software Developer in Analytics and AI to join our dynamic and focused team. As an AI/ML Engineer, you will implement core software components and contribute to the scalable design of our cloud software architecture. This is an excellent opportunity...
-
Big Data Engineering Professional
5 days ago
Singapore Virtusa Full timeWe are seeking an experienced Big Data Engineer to join our team at Virtusa in Moulmein-Kallang, Central Singapore. The successful candidate will have a strong background in big data engineering and experience working with Python, PySpark, Linux, and ETL tools like Informatica.ResponsibilitiesDesign and implement scalable big data solutions using Hive,...
-
ETL Engineer
4 weeks ago
Singapore FLINTEX CONSULTING PTE. LTD. Full timeRoles & ResponsibilitiesObjectives of this position:The objective of the position is to manage the extract/transform/load processes ensuring the data availability. Responsibilities:The holder of the position is mainly responsible for the following areas in coordination with his / her superior:•Design, create, modify extract/transform/load (ETL) pipelines...
-
ETL Informatica Developer
6 months ago
Singapore VUI SYSTEMS PTE. LTD. Full timeRoles & ResponsibilitiesJob Description:ETL (Informatica), OBIEE Designer.To Perform ETL (Informatica),OBIEE Design & Development and data modelling capabilities to support EDW to deliver NHGPBI CR & Enhancements.Role and Responsibilities:Communication: Build strong relationships with Business Intelligence Analysts to understand business requirements and...
-
Senior Big Data Developer
3 weeks ago
Singapore Helius Full timeTalend Big Data Developer RoleAt Helius, we are seeking a skilled Big Data Developer to join our team. The ideal candidate will have experience with Talend Big Data version 7+ and Hadoop, with a strong understanding of data models and data flows.Key Responsibilities:Design and develop production-grade Talend Big Data jobs with consideration for IT...
-
Senior Big Data Engineer
5 days ago
Singapore ITCAN Full timeAbout ITCANWe are a leading technology company that delivers innovative solutions to our clients.Job Title: Senior Big Data EngineerSalary Range:$170,000 - $220,000 per yearAbout the Role:We are seeking an experienced Senior Big Data Engineer to join our team. The ideal candidate will have extensive experience in designing and implementing large-scale big...