Data Engineer

3 weeks ago


Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full time
Roles & Responsibilities

Job Description:

We are looking for a skilled and motivated Data Engineer with expertise in Scala, SQL, and Hadoop to join our dynamic team. In this role, you will design, develop, and optimize scalable data pipelines and systems, collaborating with cross-functional teams to drive high-quality data solutions.

Key Responsibilities

Data Pipeline Development:

· Design and build scalable data pipelines using Scala and Hadoop.

· Develop and optimize ETL processes for data ingestion, transformation, and storage.

Data Query & Optimization:

· Write and optimize complex SQL queries for efficient data retrieval.

· Troubleshoot and enhance query performance and data workflows.

Big Data Infrastructure Management:

· Manage Hadoop-based ecosystems, including HDFS, Hive, YARN, and MapReduce.

· Monitor system performance and optimize resource utilization in distributed environments.

Collaboration & Problem-Solving:

· Partner with data analysts, scientists, and business teams to translate requirements into scalable solutions.

· Provide technical guidance and best practices for data engineering.

Automation & Monitoring:

· Develop scripts and tools to automate workflows and enhance system monitoring.

· Implement data validation mechanisms to ensure quality and consistency.

Documentation & Compliance:

· Maintain clear documentation of workflows, processes, and technical solutions.

· Ensure compliance with data governance and security policies.

Skills & Qualifications:

· Expertise in Scala, with strong functional programming knowledge.

· Strong SQL skills, including query optimization and database design.

· Hands-on experience with the Hadoop ecosystem (HDFS, Hive, YARN, MapReduce).

· Familiarity with Spark, Kafka, or Flink is a plus.

· Strong analytical and problem-solving skills to troubleshoot complex data issues.

· Excellent communication and collaboration skills.

· 6+ years of experience in data engineering or big data technologies.


Tell employers what skills you have

Machine Learning
Scala
Big Data
Pipelines
Hadoop
ETL
Data Governance
MapReduce
Data Engineering
SQL
Compliance
Python
Database Design
Data Science
Java
Databases
  • Data Engineer

    2 days ago


    Singapore NTT DATA SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities EMAIL ID : Interested candidates may also send their resume via email to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 12 months Renewable contractExperience: Minimum of 3 yearsLocation : Changi Business ParkRequirements:Min 3-4 years experience At least one year of...

  • Data Engineer

    3 weeks ago


    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on...

  • Data Engineer

    3 weeks ago


    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on...

  • Data Engineer

    1 day ago


    Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities•Bachelor's Degree in Computer Science or equivalent;•Minimum 4+ years of experience in data engineering or software engineering.•Possess a solid foundation in Computer Science concepts such as Distributed Computing, High-Velocity Data Processing, and Lambda Architecture;•Proficient in Data modeling and...

  • Data engineer

    4 weeks ago


    Singapore TOTAL EBIZ SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesJD for Software Engineer (Data Engineering) for Tech Stack Products -Design, develop, and maintain scalable data pipelines.-Collaborate with cross-functional teams to integrate data systems.-Ensure data quality and integrity across platforms.-Optimize workflows for efficiency and performance.-Perform other miscellaneous duties as...

  • Data Engineer

    3 weeks ago


    Singapore APAR TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description:We are looking for a skilled Data Engineer to join our team and support our data-driven initiatives. The ideal candidate should have strong technical expertise in Informatica, SQL, and .NET, along with experience in data engineering, migration, and analysis.Key Responsibilities:Design, develop, and maintain data...

  • Data Engineer

    3 weeks ago


    Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesJob DescriptionBachelor's Degree in Computer Science or equivalent; Minimum 5 years of experience in data engineering or software engineering; Possess a solid foundation in Computer Science concepts such as Distributed Computing, High-velocity Data Processing, and Lambda Architecture; Proficient in Data modeling and managing...

  • Data Engineer

    5 days ago


    Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesSummaryYou will be developing banking applications and supporting production environments.Responsibilities:Bachelor's Degree in Computer Science or equivalent; Minimum 4+ years of experience in data engineering or software engineering. Possess a solid foundation in Computer Science concepts such as Distributed Computing,...

  • Data Engineer

    6 days ago


    Singapore INNOCELLENCE SYSTEMS PTE. LTD. Full time

    Roles & ResponsibilitiesWe are looking for a skilled and experienced Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support the processing and analysis of clinical study and digital device sensor data. As a Data Engineer, you will work closely with data scientists and...

  • Data Engineer

    3 weeks ago


    Singapore GREEN LINK DIGITAL BANK PTE. LTD. Full time

    Roles & ResponsibilitiesAbout UsGreen Link Digital Bank is Singapore's inaugural wholesale digital bank focusing on supply chain finance, mainly serving MSMEs and aiming to help MSMEs grow and improve digitization.We are seeking a talented and driven Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and...

  • Data Engineer

    2 weeks ago


    Singapore MAESTRO HUMAN RESOURCE PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description & RequirementsWe are looking for aspiring Data Engineer/Software Developer to join our product development team, you will be responsible for the design and implementation of data integration pipeline and asynchronous data event using event driven architecture approach to consolidate data from various sources and...

  • Data Engineer

    3 weeks ago


    Singapore TALENTSIS PTE. LTD. Full time

    Roles & ResponsibilitiesCompany's Profile:Our client is an international technology and engineering company that specialises in providing innovative digital and security solutions to their esteemed clients. They are well-known for their dedication of quality delivery standards with more than 15,000 engineers globally supporting projects. They have an...

  • Data Engineer

    4 weeks ago


    Singapore SYNAPXE PTE. LTD. Full time

    Roles & ResponsibilitiesPosition Summary / Project DescriptionData Engineer for cloud migration projects (Primarily utilizing AWS, IDMC, Databricks and Tableau)Role and Responsibilities• Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and enrich data, making it suitable for analytical purposes using Databricks' Spark...

  • Data Engineer

    2 weeks ago


    Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full time

    Roles & ResponsibilitiesJob Title: Data Engineer - Mid-level/SeniorLocation: Singapore (CBD)Job Type: Full-Time PermanentKey Responsibilities:Design and maintain scalable ETL pipelines using Informatica. Optimize SQL queries and stored procedures for data manipulation. Lead data migration projects ensuring data integrity and quality. Collaborate with...

  • Data Engineer

    3 weeks ago


    Singapore YOUZU (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesWe are looking for a skilled and motivated Data Engineer to join our team. You will play a key role in designing, maintaining, and expanding our data pipelines while actively shaping the future of our BI system. If you are passionate about data engineering, ETL processes, and driving business insights, we'd love to hear from...

  • Data Engineer

    3 weeks ago


    Singapore YOUZU (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesWe are looking for a skilled and motivated Data Engineer to join our team. You will play a key role in designing, maintaining, and expanding our data pipelines while actively shaping the future of our BI system. If you are passionate about data engineering, ETL processes, and driving business insights, we’d love to hear from you! ...

  • Data Engineer

    2 weeks ago


    Singapore PERCEPT SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesDuties:Data Domain business workflow interpretation, data requirement study, data exploration, creation of entity relationship diagram, data model creation, data extraction, transformation, and loading ("ETL"), pipeline creation and servicing data requests. Data Platform Operations, setup, installation, access controls and pipeline...

  • Data Engineer

    3 weeks ago


    Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description:We are looking for a skilled and motivated Data Engineer with expertise in Scala, SQL, and Hadoop to join our dynamic team. In this role, you will design, develop, and optimize scalable data pipelines and systems, collaborating with cross-functional teams to drive high-quality data solutions.Key ResponsibilitiesData...

  • Data Engineer

    6 days ago


    Singapore DELTA SG CONSULTING Full time

    Roles & ResponsibilitiesLocation: SingaporeJob Type: Renewable Contract (Work onsite with a leading bank)Experience Level: Associate LevelWe are seeking a Data Engineer to design, develop, and implement data solutions leveraging Quantexa's cutting-edge technology. The ideal candidate will have strong expertise in data engineering, ETL pipelines, and big...

  • Data Engineer

    2 weeks ago


    Singapore CHARLES & KEITH (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesJob Responsibilities:1. Data Pipeline DevelopmentDesign, develop, and maintain scalable and reliable ETL (Extract, Transform, Load) pipelines to integrate structured and unstructured data from various sources Automate data workflows and ensure efficient data movement across platforms2. Collaboration and Team ManagementWork closely...