Large Scale Data Specialist

1 week ago

Singapore beBeeDataEngineer Full time $90,000 - $120,000
Senior Data Engineer

As a Senior Data Engineer, you will play a critical role in designing and implementing large-scale data processing and transformation pipelines in our Data Platform team. Our goal is to build a scalable compute platform that enables various teams across the company to access data, extract meaningful metrics, and perform ad-hoc analyses.

The Data Platform team deals with petabyte-scale data and provides critical functions to improve the development of reliable autonomous vehicles (AVs). We are seeking an experienced engineer to build automated pipelines for extracting information from data, transforming it into different formats, and enabling easy access to the data through interfaces.

  1. Design and Build Scalable Pipelines: You will design, build, maintain, and monitor scalable data pipelines in cloud infrastructures.
  2. Develop Self-Service Infrastructure: You will design and build self-service data platform infrastructure and backend services.
  3. Write High-Quality Code: You will write high-quality, maintainable code using distributed data processing frameworks such as Spark, Flink, or Beam.
  4. Mentor Junior Engineers: You will mentor junior engineers with high-level system design and code reviews.
  5. Communicate with Stakeholders: You will communicate with stakeholders and team leads to identify system requirements.
  6. Ensure Reliable Pipelines: You will take ownership and responsibility for reliable and efficient data pipelines.
Requirements

To succeed in this role, you must have:

  • 5+ years of professional experience as a data pipeline engineer.
  • BS or MS in Computer Science or related field.
  • Expertise with distributed data processing frameworks such as Spark, Flink, or Beam.
  • Experience with Java, Python, or Go programming languages.
  • Experience with AWS services and solutions.
  • Cloud-native backend software development experience is a plus.
  • Kubernetes experience is a strong plus.
  • Strong written and oral communication skills.
  • Comfortable working in a fast-paced, continuous delivery environment.

What We're Looking For: We are looking for an experienced data engineer who can take ownership of our data pipeline infrastructure and ensure its reliability and efficiency.

  • Large Scale Data Engineering Professional

    2 days ago

    Singapore beBeeDataEngineering Full time

    Large Scale Data Engineering Expert We are seeking an experienced Large Scale Data Engineering Expert to join our team. As a key member of our team, you will play a vital role in designing and maintaining large-scale distributed systems. The ideal candidate will have hands-on experience with Spark (Core, SQL, Streaming), a good understanding of Hadoop...

  • Large Scale Data Engineering Professional

    4 days ago

    Singapore beBeeDataEngineering Full time $120,000 - $180,000

    Large Scale Data Engineering ExpertWe are seeking an experienced Large Scale Data Engineering Expert to join our team. As a key member of our team, you will play a vital role in designing and maintaining large-scale distributed systems.The ideal candidate will have hands-on experience with Spark (Core, SQL, Streaming), a good understanding of Hadoop (HDFS,...

  • Large Scale Data Architect

    2 days ago

    Singapore beBeeData Full time $120,000 - $180,000

    We are seeking a skilled Big Data Engineer to join our E-commerce Recommendation Infrastructure team.Job DescriptionThis role involves designing and implementing large-scale recommendation systems, ensuring high-performance storage and computing systems, and troubleshooting production issues. You will work closely with applied machine learning engineers to...

  • Large Scale Data Infrastructure Specialist

    2 weeks ago

    Singapore beBeeDataInfrastructure Full time $80,000 - $120,000

    **System Architect for Large-Scale Recommendation Systems** Craft a robust data infrastructure to power offline recommendation systems serving over a billion users. Design an efficient architecture for real-time and offline data processing.Implement scalable storage solutions and computation models. Key Responsibilities:Develop large-scale distributed...

  • Large-Scale Data Architecture Specialist

    2 weeks ago

    Singapore beBeeDataArchitect Full time $120,000 - $250,000

    Job TitleWe are seeking a highly skilled professional to join our E-commerce Recommendation team as a Data Architect.You will design and implement robust offline data architecture for large-scale recommendation systems, working closely with applied machine learning engineers.Your focus will be on ensuring stability and high availability of the production...

  • Senior Large Scale Data Architect

    5 days ago

    Singapore beBeeData Full time $80,000 - $120,000

    Job SummaryWe are seeking an experienced Data Modeler to develop sophisticated models and algorithms for our recommendation systems. The ideal candidate will have expertise in large-scale data mining, machine learning, and deep learning techniques. Strong programming skills in C++ and Python, along with familiarity with Big Data tools like Hive...

  • Large Scale Data Storage Engineer

    7 days ago

    Singapore beBeeData Full time $80,000 - $120,000

    Software Engineering Opportunity">This role is responsible for crafting and implementing a storage solution for offline data in the recommendation system, catering to over a billion users.The primary objectives are to guarantee system reliability, uninterrupted service, and seamless performance. The team aims to create a storage and computing infrastructure...

  • Large Scale Data Engineering Specialist

    6 days ago

    Singapore beBeeDataEngineer Full time $90,000 - $120,000

    Are you an accomplished data professional looking for a new challenge?Our ideal candidate will be responsible for architecting and developing large-scale data pipelines that meet our business needs.Design, develop, and maintain complex data systems using cutting-edge technologies.Collaborate with cross-functional teams to understand requirements and deliver...

  • Large Scale Data Storage Engineer

    5 days ago

    Singapore beBeeData Full time

    Software Engineering Opportunity "> This role is responsible for crafting and implementing a storage solution for offline data in the recommendation system, catering to over a billion users. The primary objectives are to guarantee system reliability, uninterrupted service, and seamless performance. The team aims to create a storage and computing...

  • Large Scale Data Storage Engineer

    1 day ago

    Singapore beBeeData Full time

    Software Engineering Opportunity "> This role is responsible for crafting and implementing a storage solution for offline data in the recommendation system, catering to over a billion users. The primary objectives are to guarantee system reliability, uninterrupted service, and seamless performance. The team aims to create a storage and computing...