Senior Data Pipeline Architect

2 weeks ago

Singapore beBeeDataEngineering Full time $180,000 - $200,000
Data Engineering Expert

We are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining complex data pipelines using Python.

Responsibilities
  • Design and Develop Complex Data Pipelines:
    • Collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment.
    • Implement data integration and transformation processes to ensure optimal performance and reliability of data pipelines.
    • Optimize and fine-tune existing data pipelines / Airflow to improve efficiency, scalability, and maintainability.
  • Work Closely with AWS Services:
    • Develop and maintain documentation for data pipelines, processes, and system architecture.
    • Stay updated with the latest industry trends and best practices related to data engineering and AWS services.
  • Requirements and Qualifications:
    • Bachelor's degree in Computer Science, Engineering, or a related field.
    • Proficiency in Python, PySpark, and SQL for data processing and manipulation.
    • Min 5 years of experience in data engineering, specifically working with Apache Airflow and AWS technologies.
    • Strong knowledge of AWS services, particularly S3, Glue, EMR, Redshift, and AWS Lambda.
    • Understanding of Snowflake Data Lake is preferred.
  • Preferred Qualifications:
    • AWS certification(s) related to data engineering or big data.
    • Experience working with big data technologies like Snowflake, Spark, Hadoop, or related frameworks.
    • Familiarity with other data orchestration tools in addition to Apache Airflow.
    • Knowledge of version control systems like Bitbucket, Git.

  • Data Pipeline Architect

    7 days ago

    Singapore beBeeDataPipeline Full time $90,000 - $120,000

    About the Role:We are seeking a highly skilled Data Pipeline Architect to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing efficient data pipelines that meet the needs of our organization.Key Responsibilities:Design and develop scalable data pipelines using Python and AWS services (S3,...

  • Data Pipeline Architect

    21 hours ago

    Singapore beBeeDataPipeline Full time

    About the Role: We are seeking a highly skilled Data Pipeline Architect to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing efficient data pipelines that meet the needs of our organization. Key Responsibilities: Design and develop scalable data pipelines using Python and AWS services...

  • Data Pipeline Architect

    2 weeks ago

    Singapore beBeeDataEngineer Full time $120,000 - $180,000

    Job Description:We are seeking a Data Engineering professional to design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration. The ideal candidate will have expertise in collaborating with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment.The...

  • Senior Data Pipeline Architect

    1 week ago

    Singapore beBeeDataEngineering Full time

    Data Engineering Expert We are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining complex data pipelines using Python. Responsibilities Design and Develop Complex Data Pipelines: Collaborate with cross-functional teams to...

  • **Data Pipeline Architect

    1 week ago

    Singapore beBeeDataEngineer Full time $80,000 - $120,000

    **Senior Data Engineer Position**Our organization is seeking a skilled Senior Data Engineer to develop and maintain our data pipelines. The ideal candidate will have expertise in designing, building, and optimizing data solutions.Key Responsibilities:Enhance the existing data pipeline using industry-standard tools and technologies.Redesign and implement data...

  • Data Pipeline Architect

    2 weeks ago

    Singapore beBeeSoftwareEngineering Full time

    Key Role Responsibilities We seek a Software Engineer to work on multiple fronts, building and optimizing data pipelines for AI-driven initiatives. Design scalable and efficient workflows in support of analytics projects. Utilize Copilot Studio for AI-driven application development and automation. Implement AI Foundry solutions on Microsoft Azure,...

  • Senior Data Pipeline Architect

    1 week ago

    Singapore beBeeDataEngineer Full time $80,000 - $120,000

    About the Role:Data Engineer - Streaming PipelinesWe are seeking an experienced Senior Data Engineer to design, develop and maintain scalable data streaming pipelines that meet our business needs. This involves working with a variety of tools and technologies, including Apache Kafka, Apache Flink, and Azure Event Hub.The ideal candidate will have a strong...

  • Senior Data Architect

    3 days ago

    Singapore Matrix Process Automation Full time

    Responsibilities 10–12 years of experience in data engineering or enterprise data architecture within the banking/financial domain. Demonstrated expertise in building and managing enterprise-scale data platforms on cloud (AWS, Azure, GCP). Proven track record with technologies such as Apache Spark, Hadoop, Kafka, Snowflake, Databricks, etc. Experience...

  • Senior Data Architect

    2 weeks ago

    Singapore beBeeData Full time $113,264 - $143,924

    Job Title: Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to join our team. The ideal candidate will have experience designing and developing data pipelines, APIs, and cloud infrastructure for rail-oriented applications.The successful candidate will work closely with cross-functional teams to build efficient systems and provide...

  • Senior Data Architect

    1 week ago

    Singapore beBeeData Full time

    Job Title: Senior Data Architect We are seeking a highly skilled Senior Data Architect to join our team. The ideal candidate will have experience designing and developing data pipelines, APIs, and cloud infrastructure for rail-oriented applications. The successful candidate will work closely with cross-functional teams to build efficient systems and...