Senior Data Pipeline Architect

1 day ago

Singapore beBeeDataEngineering Full time

Data Engineering Expert

We are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining complex data pipelines using Python.

Responsibilities

  • Design and Develop Complex Data Pipelines:
    • Collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment.
    • Implement data integration and transformation processes to ensure optimal performance and reliability of data pipelines.
    • Optimize and fine-tune existing data pipelines / Airflow to improve efficiency, scalability, and maintainability.
  • Work Closely with AWS Services:
    • Develop and maintain documentation for data pipelines, processes, and system architecture.
    • Stay updated with the latest industry trends and best practices related to data engineering and AWS services.
  • Requirements and Qualifications:
    • Bachelor's degree in Computer Science, Engineering, or a related field.
    • Proficiency in Python, PySpark, and SQL for data processing and manipulation.
    • Min 5 years of experience in data engineering, specifically working with Apache Airflow and AWS technologies.
    • Strong knowledge of AWS services, particularly S3, Glue, EMR, Redshift, and AWS Lambda.
    • Understanding of Snowflake Data Lake is preferred.
  • Preferred Qualifications:
    • AWS certification(s) related to data engineering or big data.
    • Experience working with big data technologies like Snowflake, Spark, Hadoop, or related frameworks.
    • Familiarity with other data orchestration tools in addition to Apache Airflow.
    • Knowledge of version control systems like Bitbucket, Git.

  • Data Pipeline Architect

    4 days ago

    Singapore beBeeDataEngineer Full time $120,000 - $180,000

    Job Description:We are seeking a Data Engineering professional to design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration. The ideal candidate will have expertise in collaborating with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment.The...

  • Senior Data Pipeline Architect

    5 days ago

    Singapore beBeeDataEngineering Full time $180,000 - $200,000

    Data Engineering ExpertWe are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining complex data pipelines using Python. Responsibilities Design and Develop Complex Data Pipelines: Collaborate with cross-functional teams to understand data...

  • Data Pipeline Architect

    1 week ago

    Singapore beBeeSoftwareEngineering Full time $120,000 - $190,000

    Key Role ResponsibilitiesWe seek a Software Engineer to work on multiple fronts, building and optimizing data pipelines for AI-driven initiatives.Design scalable and efficient workflows in support of analytics projects.Utilize Copilot Studio for AI-driven application development and automation.Implement AI Foundry solutions on Microsoft Azure, ensuring...

  • Data Pipeline Architect

    4 days ago

    Singapore beBeeSoftwareEngineering Full time

    Key Role Responsibilities We seek a Software Engineer to work on multiple fronts, building and optimizing data pipelines for AI-driven initiatives. Design scalable and efficient workflows in support of analytics projects. Utilize Copilot Studio for AI-driven application development and automation. Implement AI Foundry solutions on Microsoft Azure,...

  • Senior Data Architect

    3 days ago

    Singapore beBeeData Full time $113,264 - $143,924

    Job Title: Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to join our team. The ideal candidate will have experience designing and developing data pipelines, APIs, and cloud infrastructure for rail-oriented applications.The successful candidate will work closely with cross-functional teams to build efficient systems and provide...

  • Senior Data Architect

    1 day ago

    Singapore beBeeData Full time

    Job Title: Senior Data Architect We are seeking a highly skilled Senior Data Architect to join our team. The ideal candidate will have experience designing and developing data pipelines, APIs, and cloud infrastructure for rail-oriented applications. The successful candidate will work closely with cross-functional teams to build efficient systems and...

  • Senior Data Pipeline Architect

    1 day ago

    Singapore beBeeDataEngineer Full time $80,000 - $120,000

    About the Role:Data Engineer - Streaming PipelinesWe are seeking an experienced Senior Data Engineer to design, develop and maintain scalable data streaming pipelines that meet our business needs. This involves working with a variety of tools and technologies, including Apache Kafka, Apache Flink, and Azure Event Hub.The ideal candidate will have a strong...

  • Data Pipeline Architect

    2 days ago

    Singapore beBeeData Full time $150,000 - $200,000

    Job DescriptionWe are seeking a talented Senior Data Engineer to join our team. In this role, you will be responsible for designing, developing, and maintaining data pipelines and ETL/ELT processes.Develop maintainable data pipelines using unit and integration testing.Collaborate with data teams to automate deployment and monitoring.Optimize data storage and...

  • Data Pipeline Specialist

    3 days ago

    Singapore beBeeData Full time $160,000 - $200,000

    Senior Data ArchitectWe are seeking a highly skilled data engineer with expertise in designing, building, and maintaining robust data pipelines. The ideal candidate will have a strong background in data architecture, ETL processes, and data governance.Key Responsibilities:Develop and optimize data models, data warehouses, and ETL processes to support...

  • Senior Data Pipeline Architect

    1 day ago

    Singapore beBeeDataEngineer Full time $90,000 - $120,000

    Unlock Your Data Engineering PotentialWe are seeking a highly skilled and self-driven professional to design, develop, and maintain scalable data pipelines and architectures, enabling effective data management, analytics, and governance.Design and develop efficient data pipelines using modern data engineering tools.Build and manage data lakes, data...