Senior Data Pipeline Engineer

3 days ago

Singapore beBeeDataEngineering Full time

Unlock the Power of Data Engineering

Design and Develop Complex Data Pipelines

We are seeking a highly skilled data engineer to join our team. The ideal candidate will have experience in designing, developing, and maintaining complex data pipelines using Python for efficient data processing and orchestration.

Collaborate with Cross-Functional Teams

The successful candidate will collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment. They will work closely with AWS services like S3, Glue, EMR, Redshift, and other related technologies to design and optimize data infrastructure.

Optimize and Fine-Tune Data Pipelines

Troubleshoot and Resolve Issues

The successful candidate will troubleshoot and resolve issues related to data pipelines, ensuring smooth operation and minimal downtime.

Required Skills and Qualifications

  • Proficiency in Python, PySpark, and SQL for data processing and manipulation
  • Minimum of 5 years of experience in data engineering, specifically working with Apache Airflow and AWS technologies
  • Strong knowledge of AWS services, particularly S3, Glue, EMR, Redshift, and AWS Lambda
  • Understanding of Snowflake Data Lake is preferred

Benefits

This role offers excellent opportunities for career growth and development in a fast-paced, collaborative environment. The successful candidate will be part of a dynamic team that values innovation, creativity, and technical expertise.

Others

Excellent problem-solving skills and ability to work effectively in a team environment are essential. Effective communication skills and the ability to articulate technical concepts to non-technical stakeholders are also necessary.

  • Senior Data Pipeline Engineer

    1 week ago

    Singapore MOTIONAL SINGAPORE PTE. LIMITED Full time

    Roles & Responsibilities Mission Summary: We are seeking a talented Senior Data Pipeline Engineer to design and implement robust large scale data processing and transformation pipelines in the Data Platform team. The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data,...

  • Senior Data Pipeline Engineer

    2 weeks ago

    Singapore MOTIONAL SINGAPORE PTE. LIMITED Full time

    Roles & ResponsibilitiesMission Summary:We are seeking a talented Senior Data Pipeline Engineer to design and implement robust large scale data processing and transformation pipelines in the Data Platform team.The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data, extract...

  • Senior Data Pipeline Engineer

    5 days ago

    Singapore Motional Full time

    **Mission Summary**: We are seeking a talented Senior Data Pipeline Engineer to design and implement robust large scale data processing and transformation pipelines in the Data Platform team. The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data, extract meaningful automated...

  • **Data Pipeline Architect

    6 days ago

    Singapore beBeeDataEngineer Full time $80,000 - $120,000

    **Senior Data Engineer Position**Our organization is seeking a skilled Senior Data Engineer to develop and maintain our data pipelines. The ideal candidate will have expertise in designing, building, and optimizing data solutions.Key Responsibilities:Enhance the existing data pipeline using industry-standard tools and technologies.Redesign and implement data...

  • Senior Data Pipeline Engineer

    7 days ago

    Singapore Motional Full time $104,000 - $130,878 per year

    Mission Summary:We are seeking a talented Senior Data Pipeline Engineer to design and implement robust large scale data processing and transformation pipelines in the Data Platform team.The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data, extract meaningful automated metrics...

  • Senior Data Pipeline Engineer

    4 days ago

    Singapore beBeeDataEngineering Full time $102,600 - $144,600

    Unlock the Power of Data EngineeringDesign and Develop Complex Data PipelinesWe are seeking a highly skilled data engineer to join our team. The ideal candidate will have experience in designing, developing, and maintaining complex data pipelines using Python for efficient data processing and orchestration.Collaborate with Cross-Functional TeamsThe...

  • Pipeline Data Engineer

    2 weeks ago

    Singapore beBeeData Full time $80,000 - $120,000

    Job Title:ETL Specialist">A strong ETL pipeline support engineer is required to ensure the smooth operation of our DevOps team's production pipelines. Key responsibilities will include monitoring and troubleshooting existing pipelines to maintain optimal performance and data reliability.">This role involves working with various technologies such as SQL,...

  • Senior Data Pipeline Architect

    7 days ago

    Singapore beBeeDataEngineer Full time $80,000 - $120,000

    About the Role:Data Engineer - Streaming PipelinesWe are seeking an experienced Senior Data Engineer to design, develop and maintain scalable data streaming pipelines that meet our business needs. This involves working with a variety of tools and technologies, including Apache Kafka, Apache Flink, and Azure Event Hub.The ideal candidate will have a strong...

  • Senior Data Pipeline Engineer

    2 weeks ago

    Singapore beBeeDataEngineering Full time $80,000 - $120,000

    Job Title: Data Engineering SpecialistWe are seeking a skilled professional to support the adoption of next-generation AI and ML solutions.This role involves designing and implementing data pipelines, developing interactive dashboards, and integrating AI-driven components into security workflows.Develop and maintain SQL queries, data tables, and schemas to...

  • Transformative Senior Data Pipeliner

    3 days ago

    Singapore beBeeEngineer Full time $70,000 - $120,000

    Senior Data Engineer OpportunityWe are seeking a skilled Senior Data Engineer to design and implement robust large-scale data processing and transformation pipelines in our Data Platform team. The ideal candidate will have expertise in distributed data processing frameworks, such as Apache Spark, Flink, or Beam, and experience with cloud-native backend...