Senior Data Pipeline Engineer

3 weeks ago

Singapore MOTIONAL SINGAPORE PTE. LIMITED Full time
Roles & Responsibilities

Mission Summary:

We are seeking a talented Senior Data Pipeline Engineer to design and implement robust large scale data processing and transformation pipelines in the Data Platform team.

The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data, extract meaningful automated metrics out of the data, and perform various ad-hoc analyses on the data. We deal with data on the petabyte scale and provide critical functions to improve the development of a reliable AV by allowing various researchers and engineers to understand how the AV performs various tasks and scenarios in real world or simulated environments. The Data Platform team is responsible for building automated pipelines to perform extraction of information from the data, transformation of data into different formats that can be consumed by downstream services and for building interfaces to enable easy access to the data.

What You'll Be Doing

  • Design, build, maintain and monitor scalable data pipelines in the cloud infra.
  • Design and build self-service data platform infrastructure and backend services
  • Write high quality, maintainable code
  • Mentor junior engineers with high-level system design and code reviews
  • Communicate with stakeholders and team leads to identify system requirements
  • Take a strong sense of ownership and responsibility for reliable and efficient data pipelines.

What We're Looking For

  • 5+ years of professional work experience as a data pipeline engineer.
  • BS or MS in Computer Science or related field
  • Expertise with distributed data processing frameworks, such as Spark, Flink, Beam
  • Expertise with Java, Python or Go
  • Experience with AWS services and solutions
  • Experience with cloud-native backend software development is a plus
  • Experience with Kubernetes is a strong plus
  • Strong written and oral communication skills
  • Comfortable working in a fast-paced, continuous delivery environment
Tell employers what skills you have

Oral Communication Skills
Scala
Kubernetes
Big Data
Pipelines
Hadoop
Data Transformation
ETL
Data Engineering
SQL
System Design
Python
AV
Java
Databases
Software Development

  • Senior Data Pipeline Engineer

    1 week ago

    Singapore Motional Full time

    **Mission Summary**: We are seeking a talented Senior Data Pipeline Engineer to design and implement robust large scale data processing and transformation pipelines in the Data Platform team. The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data, extract meaningful automated...

  • **Data Pipeline Architect

    2 weeks ago

    Singapore beBeeDataEngineer Full time $80,000 - $120,000

    **Senior Data Engineer Position**Our organization is seeking a skilled Senior Data Engineer to develop and maintain our data pipelines. The ideal candidate will have expertise in designing, building, and optimizing data solutions.Key Responsibilities:Enhance the existing data pipeline using industry-standard tools and technologies.Redesign and implement data...

  • Senior Data Pipeline Engineer

    2 weeks ago

    Singapore Motional Full time $104,000 - $130,878 per year

    Mission Summary:We are seeking a talented Senior Data Pipeline Engineer to design and implement robust large scale data processing and transformation pipelines in the Data Platform team.The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data, extract meaningful automated metrics...

  • Senior Data Pipeline Engineer

    1 week ago

    Singapore beBeeDataEngineering Full time $102,600 - $144,600

    Unlock the Power of Data EngineeringDesign and Develop Complex Data PipelinesWe are seeking a highly skilled data engineer to join our team. The ideal candidate will have experience in designing, developing, and maintaining complex data pipelines using Python for efficient data processing and orchestration.Collaborate with Cross-Functional TeamsThe...

  • Senior Data Pipeline Architect

    2 weeks ago

    Singapore beBeeDataEngineer Full time $80,000 - $120,000

    About the Role:Data Engineer - Streaming PipelinesWe are seeking an experienced Senior Data Engineer to design, develop and maintain scalable data streaming pipelines that meet our business needs. This involves working with a variety of tools and technologies, including Apache Kafka, Apache Flink, and Azure Event Hub.The ideal candidate will have a strong...

  • Senior Data Pipeline Engineer

    1 week ago

    Singapore beBeeDataEngineering Full time

    Unlock the Power of Data Engineering Design and Develop Complex Data Pipelines We are seeking a highly skilled data engineer to join our team. The ideal candidate will have experience in designing, developing, and maintaining complex data pipelines using Python for efficient data processing and orchestration. Collaborate with Cross-Functional Teams ...

  • Transformative Senior Data Pipeliner

    1 week ago

    Singapore beBeeEngineer Full time $70,000 - $120,000

    Senior Data Engineer OpportunityWe are seeking a skilled Senior Data Engineer to design and implement robust large-scale data processing and transformation pipelines in our Data Platform team. The ideal candidate will have expertise in distributed data processing frameworks, such as Apache Spark, Flink, or Beam, and experience with cloud-native backend...

  • Senior Data Pipeline Engineer

    2 weeks ago

    Singapore beBeeMACHINE Full time $80,000 - $120,000

    Key ResponsibilitiesWe are seeking a highly skilled engineer to support the creation, maintenance, and optimization of our internal data, training & evaluation pipelines. This involves working closely with ML engineers to enhance tools and processes throughout the ML development lifecycle.The successful candidate will participate in design reviews and code...

  • Senior Data Pipeline Specialist

    1 week ago

    Singapore beBeeDataEngineer Full time $90,000 - $120,000

    About the RoleWe are seeking a Senior Data Pipeline Engineer to join our team and contribute to the design, implementation, and maintenance of robust large-scale data processing and transformation pipelines in our Data Platform.The Data Platform is responsible for building scalable compute platforms that enable diverse teams across the company to access...

  • Leading Data Pipeline Architect

    1 week ago

    Singapore beBeeDataEngineer Full time $90,000 - $120,000

    Job Title: Senior Data EngineerWe are looking for a skilled Senior Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing and implementing data pipelines using industry-standard tools and mechanisms.Responsibilities:Enhance the existing data pipeline using industry-standard tools and mechanisms.Redesign...