Senior Data Pipeline Engineer

4 weeks ago


Singapore MOTIONAL SINGAPORE PTE. LIMITED Full time
Roles & Responsibilities

Mission Summary:

We are seeking a talented Senior Data Pipeline Engineer to design and implement robust large scale data processing and transformation pipelines in the Data Platform team.

The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data, extract meaningful automated metrics out of the data, and perform various ad-hoc analyses on the data. We deal with data on the petabyte scale and provide critical functions to improve the development of a reliable AV by allowing various researchers and engineers to understand how the AV performs various tasks and scenarios in real world or simulated environments. The Data Platform team is responsible for building automated pipelines to perform extraction of information from the data, transformation of data into different formats that can be consumed by downstream services and for building interfaces to enable easy access to the data.

What You'll Be Doing

  • Design, build, maintain and monitor scalable data pipelines in the cloud infra.
  • Design and build self-service data platform infrastructure and backend services
  • Write high quality, maintainable code
  • Mentor junior engineers with high-level system design and code reviews
  • Communicate with stakeholders and team leads to identify system requirements
  • Take a strong sense of ownership and responsibility for reliable and efficient data pipelines.

What We're Looking For

  • 5+ years of professional work experience as a data pipeline engineer.
  • BS or MS in Computer Science or related field
  • Expertise with distributed data processing frameworks, such as Spark, Flink, Beam
  • Expertise with Java, Python or Go
  • Experience with AWS services and solutions
  • Experience with cloud-native backend software development is a plus
  • Experience with Kubernetes is a strong plus
  • Strong written and oral communication skills
  • Comfortable working in a fast-paced, continuous delivery environment
Tell employers what skills you have

Oral Communication Skills
Scala
Kubernetes
Big Data
Pipelines
Hadoop
Data Transformation
ETL
Data Engineering
SQL
System Design
Python
AV
Java
Databases
Software Development

  • Singapore Nicoll Curtin - Singapore Full time

    Join Our TeamWe are seeking an experienced Data Engineer to join our team in Singapore.The successful candidate will design, develop, and maintain data pipelines and backend services for real-time decisioning, reporting, data collecting, and related functions.About Nicoll Curtin - SingaporeNicoll Curtin - Singapore is a leading professional services firm...

  • Data Engineer

    7 hours ago


    Singapore NTT DATA SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities EMAIL ID : Interested candidates may also send their resume via email to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 12 months Renewable contractExperience: Minimum of 3 yearsLocation : Changi Business ParkRequirements:Min 3-4 years experience At least one year of...

  • Senior Data Engineer

    3 weeks ago


    Singapore JAC RECRUITMENT PTE. LTD. Full time

    Roles & ResponsibilitiesCOMPANY OVERVIEWOur client renowned for its exceptional customer experience, innovative facilities, and commitment to sustainability. Key features include a complex with extensive retail and dining options, and unique attractions.We are currently looking for a Senior Data Engineer. JOB RESPONSIBILITIES· Design, implement, and...

  • Senior Data Engineer

    3 weeks ago


    Singapore JAC RECRUITMENT PTE. LTD. Full time

    Roles & ResponsibilitiesCOMPANY OVERVIEWOur client renowned for its exceptional customer experience, innovative facilities, and commitment to sustainability. Key features include a complex with extensive retail and dining options, and unique attractions.We are currently looking for a Senior Data Engineer. JOB RESPONSIBILITIES· Design, implement, and...

  • Senior Data Engineer

    7 hours ago


    Singapore RANDSTAD PTE. LIMITED Full time

    Roles & ResponsibilitiesOur client is a game publisher based in Singapore, dedicated to delivering high-quality casual games worldwide. With a focus on innovation, creativity, and humor, it supports developers from development to launch, creating unforgettable gaming experiences.about the jobDesign, develop, and maintain scalable data pipelines to process...


  • Singapore EPS COMPUTER SYSTEMS PTE LTD Full time

    Roles & ResponsibilitiesAs a Machine Learning Data Engineer, you will be responsible for designing, implementing, and maintaining the data pipelines and infrastructure that support our machine learning projects. You will work closely with data scientists, machine learning engineers, cloud engineer and other cross-functional teams to ensure the availability,...


  • Singapore EDENRED PTE. LTD. Full time

    Roles & ResponsibilitiesRole MissionsThe Senior Data Engineer owns, supports, and improves the data capabilities in terms of collecting, managing, and converting raw data into information that can be interpreted by data analysts and data scientists.The goals will be to define, build and improve the architecture, tools and procedures for data pipelining,...

  • Senior Data Engineer

    3 weeks ago


    Singapore HAYS SPECIALIST RECRUITMENT PTE. LTD. Full time

    Roles & ResponsibilitiesWe are looking for Senior Data Engineer to join Data Engineer team squad. You will be responsible for platform administration, operational support, small change and release management. Larger, more complex changes are delivered by an L3 squad and project teams.Key Responsibilities:Release Management and Support activity (~60%):·...


  • Singapore RANDSTAD PTE. LIMITED Full time

    Roles & Responsibilitiesabout the companyA Singapore-based game publisher dedicated to bringing high-quality casual games to a global audience. Seeking a Senior Data Engineer to design and manage data pipelines and infrastructure for our advanced user growth platform. This role will ensure smooth data integration and enable real-time analytics...

  • Data Engineer

    1 week ago


    Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full time

    Roles & ResponsibilitiesJob Title: Data Engineer - Mid-level/SeniorLocation: Singapore (CBD)Job Type: Full-Time PermanentKey Responsibilities:Design and maintain scalable ETL pipelines using Informatica. Optimize SQL queries and stored procedures for data manipulation. Lead data migration projects ensuring data integrity and quality. Collaborate with...

  • Data Engineer

    1 week ago


    Singapore MAESTRO HUMAN RESOURCE PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description & RequirementsWe are looking for aspiring Data Engineer/Software Developer to join our product development team, you will be responsible for the design and implementation of data integration pipeline and asynchronous data event using event driven architecture approach to consolidate data from various sources and...

  • Data Engineer

    3 weeks ago


    Singapore RANDSTAD PTE. LIMITED Full time

    Roles & Responsibilitiesabout the companyA Singapore-based game publisher dedicated to bringing high-quality casual games to a global audience. Seeking a Senior Data Engineer to design and manage data pipelines and infrastructure for our advanced user growth platform. This role will ensure smooth data integration and enable real-time analytics...

  • Senior Data Engineer

    3 weeks ago


    Singapore ACHIEVE CAREER CONSULTANT PTE LTD Full time

    Roles & ResponsibilitiesRole Overview:As a Senior Data Engineer, you will be responsible for acquiring, storing, governing, and processing large volumes of structured and unstructured data. You will contribute to designing optimal architecture components, implementing enterprise data foundations such as data lakes, and supporting data-driven decision-making....

  • Senior Data Engineer

    3 weeks ago


    Singapore ACHIEVE CAREER CONSULTANT PTE LTD Full time

    Roles & ResponsibilitiesRole Overview:As a Senior Data Engineer, you will be responsible for acquiring, storing, governing, and processing large volumes of structured and unstructured data. You will contribute to designing optimal architecture components, implementing enterprise data foundations such as data lakes, and supporting data-driven decision-making....

  • Data Engineer

    1 week ago


    Singapore RANDSTAD PTE. LIMITED Full time

    Roles & Responsibilitiesabout company I am currently working with a leading and reputable game studio. HQ in SG. 1,500 employees in China with 30+ employees in Singapore.Salary budget open Base salary + AWS + variable bonus2-3 rounds of interview to offer stage. 5 days in office.about jobDesign, develop, and maintain scalable data pipelines to process and...

  • Senior Data Engineer

    2 weeks ago


    Singapore IOTALENTS PTE. LTD. Full time

    Roles & ResponsibilitiesJoin a leading organization at the forefront of innovation, where data powers critical operations on a massive scale. As a key player in one of the world's most complex and dynamic environments, the company handle vast amounts of real-time data from multiple sources—spanning sensor networks, operational systems, and passenger...


  • Singapore Meliora Full time

    At Meliora, we are seeking a highly experienced Senior Director of Data to lead our regional data engineering teams.This role will include the following:Designing and implementing data engineering solutions that meet our business needsOptimising data pipelines for reliability and performanceLiaising with regional and global teams to align with our data...

  • Lead Data Engineer

    3 weeks ago


    Singapore VANGUARD SOFTWARE PTE. LTD. Full time

    Roles & ResponsibilitiesJOB SUMMARYWe are looking for a talented and experienced Lead Data Engineer to join our innovative team. The Lead Data Engineer will play a critical role in leading the design, development, and maintenance of our data infrastructure, pipelines, and analytical tools. The ideal candidate will have a strong technical background in data...


  • Singapore Meliora Full time

    This role will include the following:  Architect, implement and design data engineering solutions  Optimise data pipelines for reliability and performance  Lead a team of 10 regionally distributed data professionals  Liaise with regional and global teams to align with data strategy  Work with data management and analytics teams to align...

  • Data Engineer

    5 days ago


    Singapore INNOCELLENCE SYSTEMS PTE. LTD. Full time

    Roles & ResponsibilitiesWe are looking for a skilled and experienced Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support the processing and analysis of clinical study and digital device sensor data. As a Data Engineer, you will work closely with data scientists and...