Senior Pipeline Engineer

1 week ago


Singapore beBeeDataEngineer Full time $80,000 - $120,000
Job Description">As a pipeline support engineer, you will be an integral part of our DevOps team, ensuring the smooth operation of PROD ETL pipelines. Your primary responsibility will be to monitor and troubleshoot existing pipelines to maintain optimal performance and data reliability.">

Our ideal candidate possesses a strong understanding of SQL and Spark, along with hands-on experience with AWS Glue and Redshift. You must have expertise in relational databases, distributed computing, and AWS data services for success in this role.

Key Requirements:">
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Proven experience in supporting and maintaining ETL pipelines.
  • Proficiency in SQL and relational databases (e.g., Redshift).
  • Understanding of distributed computing and experience with Apache Spark.
  • Hands-on experience with AWS Glue and other AWS data services.
  • Knowledge of data warehousing concepts and best practices.
  • Strong problem-solving, analytical, communication, and collaboration skills.
  • Ability to work both independently and as part of a team.
">Preferred Skills:">
  • Familiarity with other ETL tools and technologies.
  • Proficiency in scripting languages like Python.
  • Knowledge of Agile development methodologies.
  • Experience with data visualization tools such as Tableau or Power BI.
">Responsibilities:">
  • Monitor and maintain existing ETL pipelines to ensure data quality and availability.
  • Identify and resolve pipeline issues and data errors promptly.
  • Troubleshoot data integration processes effectively.
  • Collaborate with data engineers and stakeholders to resolve complex issues when necessary.
  • Develop and update documentation for ETL processes and pipelines.
  • Participate in the on-call rotation for production support to ensure continuous pipeline operations.
"],

  • Singapore MOTIONAL SINGAPORE PTE. LIMITED Full time

    Roles & ResponsibilitiesMission Summary:We are seeking a talented Senior Data Pipeline Engineer to design and implement robust large scale data processing and transformation pipelines in the Data Platform team.The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data, extract...


  • Singapore MOTIONAL SINGAPORE PTE. LIMITED Full time

    Roles & Responsibilities Mission Summary: We are seeking a talented Senior Data Pipeline Engineer to design and implement robust large scale data processing and transformation pipelines in the Data Platform team. The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data,...


  • Singapore Motional Full time

    **Mission Summary**: We are seeking a talented Senior Data Pipeline Engineer to design and implement robust large scale data processing and transformation pipelines in the Data Platform team. The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data, extract meaningful automated...


  • Singapore DIGITAL ROUNDABOUT PTE. LTD. Full time

    Roles & ResponsibilitiesRole OverviewWe are looking for a Software Engineer – Video Pipelines to join our Video AI Platform team. This role is focused on building robust, high-performance video pipelines for both Video-on-Demand (VoD) and Live streaming systems. You will be hands-on in implementing modules for video decoding, encoding, transcoding, and...


  • Singapore ELPA ASIA PTE. LTD. Full time

    Roles & ResponsibilitiesRole OverviewWe are looking for a Software Engineer – Video Pipelines to join our Video AI Platform team. This role is focused on building robust, high-performance video pipelines for both Video-on-Demand (VoD) and Live streaming systems. You will be hands-on in implementing modules for video decoding, encoding, transcoding, and...


  • Singapore Motional Full time $104,000 - $130,878 per year

    Mission Summary:We are seeking a talented Senior Data Pipeline Engineer to design and implement robust large scale data processing and transformation pipelines in the Data Platform team.The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data, extract meaningful automated metrics...


  • Singapore ELPA ASIA PTE. LTD. Full time $125,000 - $175,000 per year

    Role OverviewWe are looking for a Software Engineer – Video Pipelines to join our Video AI Platform team. This role is focused on building robust, high-performance video pipelines for both Video-on-Demand (VoD) and Live streaming systems . You will be hands-on in implementing modules for video decoding, encoding, transcoding, and modification , ensuring...

  • Software Engineer

    1 day ago


    Singapore ELPA ASIA PTE. LTD. Full time

    Role Overview We are looking for a Software Engineer – Video Pipelines to join our Video AI Platform team. This role is focused on building robust, high-performance video pipelines for both Video-on-Demand (VoD) and Live streaming systems . You will be hands-on in implementing modules for video decoding, encoding, transcoding, and modification , ensuring...


  • Singapore beBeeDataEngineering Full time $102,600 - $144,600

    Unlock the Power of Data EngineeringDesign and Develop Complex Data PipelinesWe are seeking a highly skilled data engineer to join our team. The ideal candidate will have experience in designing, developing, and maintaining complex data pipelines using Python for efficient data processing and orchestration.Collaborate with Cross-Functional TeamsThe...


  • Singapore beBeeDataEngineer Full time $80,000 - $120,000

    **Senior Data Engineer Position**Our organization is seeking a skilled Senior Data Engineer to develop and maintain our data pipelines. The ideal candidate will have expertise in designing, building, and optimizing data solutions.Key Responsibilities:Enhance the existing data pipeline using industry-standard tools and technologies.Redesign and implement data...