Senior Data Pipeline Engineer

4 days ago

Singapore MOTIONAL SINGAPORE PTE. LIMITED Full time
Roles & Responsibilities

Mission Summary:

We are seeking a talented Senior Data Pipeline Engineer to design and implement robust large scale data processing and transformation pipelines in the Data Platform team.

The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data, extract meaningful automated metrics out of the data, and perform various ad-hoc analyses on the data. We deal with data on the petabyte scale and provide critical functions to improve the development of a reliable AV by allowing various researchers and engineers to understand how the AV performs various tasks and scenarios in real world or simulated environments. The Data Platform team is responsible for building automated pipelines to perform extraction of information from the data, transformation of data into different formats that can be consumed by downstream services and for building interfaces to enable easy access to the data.

What You'll Be Doing

  • Design, build, maintain and monitor scalable data pipelines in the cloud infra.
  • Design and build self-service data platform infrastructure and backend services
  • Write high quality, maintainable code
  • Mentor junior engineers with high-level system design and code reviews
  • Communicate with stakeholders and team leads to identify system requirements
  • Take a strong sense of ownership and responsibility for reliable and efficient data pipelines.

What We're Looking For

  • 5+ years of professional work experience as a data pipeline engineer.
  • BS or MS in Computer Science or related field
  • Expertise with distributed data processing frameworks, such as Spark, Flink, Beam
  • Expertise with Java, Python or Go
  • Experience with AWS services and solutions
  • Experience with cloud-native backend software development is a plus
  • Experience with Kubernetes is a strong plus
  • Strong written and oral communication skills
  • Comfortable working in a fast-paced, continuous delivery environment
Tell employers what skills you have
Oral Communication Skills
Scala
Kubernetes
Big Data
Pipelines
Hadoop
Data Transformation
ETL
Data Engineering
SQL
System Design
Python
AV
Java
Databases
Software Development

  • Senior Data Pipeline Engineer

    2 weeks ago

    Singapore MOTIONAL SINGAPORE PTE. LIMITED Full time

    Roles & ResponsibilitiesMission Summary:We are seeking a talented Senior Data Pipeline Engineer to design and implement robust large scale data processing and transformation pipelines in the Data Platform team.The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data, extract...

  • Senior Data Pipeline Engineer

    1 day ago

    Singapore Motional Full time $104,000 - $130,878 per year

    Mission Summary:We are seeking a talented Senior Data Pipeline Engineer to design and implement robust large scale data processing and transformation pipelines in the Data Platform team.The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data, extract meaningful automated metrics...

  • Pipeline Data Engineer

    1 week ago

    Singapore beBeeData Full time $80,000 - $120,000

    Job Title:ETL Specialist">A strong ETL pipeline support engineer is required to ensure the smooth operation of our DevOps team's production pipelines. Key responsibilities will include monitoring and troubleshooting existing pipelines to maintain optimal performance and data reliability.">This role involves working with various technologies such as SQL,...

  • Senior Data Pipeline Architect

    1 day ago

    Singapore beBeeDataEngineer Full time $80,000 - $120,000

    About the Role:Data Engineer - Streaming PipelinesWe are seeking an experienced Senior Data Engineer to design, develop and maintain scalable data streaming pipelines that meet our business needs. This involves working with a variety of tools and technologies, including Apache Kafka, Apache Flink, and Azure Event Hub.The ideal candidate will have a strong...

  • Senior Data Pipeline Engineer

    5 days ago

    Singapore beBeeDataEngineering Full time $80,000 - $120,000

    Job Title: Data Engineering SpecialistWe are seeking a skilled professional to support the adoption of next-generation AI and ML solutions.This role involves designing and implementing data pipelines, developing interactive dashboards, and integrating AI-driven components into security workflows.Develop and maintain SQL queries, data tables, and schemas to...

  • Senior Data Pipeline Engineer

    12 hours ago

    Singapore beBeeMACHINE Full time $80,000 - $120,000

    Key ResponsibilitiesWe are seeking a highly skilled engineer to support the creation, maintenance, and optimization of our internal data, training & evaluation pipelines. This involves working closely with ML engineers to enhance tools and processes throughout the ML development lifecycle.The successful candidate will participate in design reviews and code...

  • Senior Data Pipeline Engineer, Team Lead

    1 week ago

    Singapore Motional Full time

    We are seeking a talented **Senior Data Pipeline Engineer**, **Team Lead **to implement robust large scale data processing and transformation pipelines for our Data Pipelines team under Data Platform. The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data, extract meaningful...

  • Data Engineer

    1 week ago

    Singapore NTT DATA, Inc. Full time

    Join to apply for the Data Engineer role at NTT DATA, Inc. . Overview As part of our data-driven transformation initiatives, we are looking for a motivated Associate Data Engineer to join our team. This role is ideal for early-career professionals who are passionate about building scalable data pipelines, integrating diverse data sources, and enabling...

  • Senior Data Pipeline Developer

    5 days ago

    Singapore beBeeDataEngineer Full time $120,000 - $180,000

    Key ResponsibilitiesWe are seeking a skilled Data Engineer to join our team in designing and developing scalable data pipelines. The ideal candidate will have hands-on experience building data pipelines and integrating data workflows to support ML and analytics use cases.The selected individual will work closely with data engineers, ML engineers, and...

  • Data Pipeline Architect

    2 days ago

    Singapore beBeeData Full time $150,000 - $200,000

    Job DescriptionWe are seeking a talented Senior Data Engineer to join our team. In this role, you will be responsible for designing, developing, and maintaining data pipelines and ETL/ELT processes.Develop maintainable data pipelines using unit and integration testing.Collaborate with data teams to automate deployment and monitoring.Optimize data storage and...