Data Pipeline Architect

2 days ago

Singapore beBeeDataEngineer Full time $100,000 - $130,000
Job Title: Data Engineer

We are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will design, develop, and optimize data pipelines using AWS services.

Responsibilities:
  • Design and implement ETL/ELT pipelines using AWS Glue, Athena, S3, Redshift, and Iceberg.
  • Implement monitoring and alerting mechanisms for data workflows to ensure reliability and timely issue resolution.
  • Perform database and schema optimization to improve performance, scalability, and cost efficiency.
  • Manage data validation, taxonomy updates, and metadata consistency across pipelines and environments.
  • Refactor, clean up, and maintain data jobs, tables, and legacy pipelines to align with best practices.
  • Oversee infrastructure upgrades such as EKS cluster updates and database cleanup activities.
  • Automate job scheduling and parameterization for flexible and efficient data processing.
  • Collaborate with cross-functional teams to integrate external datasets and ensure compliance with data governance standards.
Requirements:
  • Strong proficiency in AWS cloud services: Glue, S3, Athena, Redshift, IAM, and EKS.
  • Experience in ETL/ELT pipeline design, optimization, and troubleshooting.
  • Solid understanding of SQL, Python, and data transformation frameworks.
  • Knowledge of data modeling, schema design, and performance tuning.
  • Familiarity with DevOps practices, including automation, CI/CD, and monitoring solutions.
  • Ability to manage data quality, validation, and governance processes.
  • Nice to have experience with data cataloging and metadata management tools.
  • Exposure to real-time or near real-time data processing.
  • Knowledge of multi-layered data architectures.

Interested applicants, please email your resume.

  • Data Pipeline Architect

    3 days ago

    Singapore beBeeDataPipeline Full time $90,000 - $120,000

    About the Role:We are seeking a highly skilled Data Pipeline Architect to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing efficient data pipelines that meet the needs of our organization.Key Responsibilities:Design and develop scalable data pipelines using Python and AWS services (S3,...

  • Data Pipeline Architect

    1 week ago

    Singapore beBeeDataEngineer Full time $120,000 - $180,000

    Job Description:We are seeking a Data Engineering professional to design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration. The ideal candidate will have expertise in collaborating with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment.The...

  • Data Pipeline Architect

    2 weeks ago

    Singapore beBeeSoftwareEngineering Full time $120,000 - $190,000

    Key Role ResponsibilitiesWe seek a Software Engineer to work on multiple fronts, building and optimizing data pipelines for AI-driven initiatives.Design scalable and efficient workflows in support of analytics projects.Utilize Copilot Studio for AI-driven application development and automation.Implement AI Foundry solutions on Microsoft Azure, ensuring...

  • Data Pipeline Architect

    1 week ago

    Singapore beBeeSoftwareEngineering Full time

    Key Role Responsibilities We seek a Software Engineer to work on multiple fronts, building and optimizing data pipelines for AI-driven initiatives. Design scalable and efficient workflows in support of analytics projects. Utilize Copilot Studio for AI-driven application development and automation. Implement AI Foundry solutions on Microsoft Azure,...

  • Senior Data Pipeline Architect

    2 weeks ago

    Singapore beBeeDataEngineering Full time $180,000 - $200,000

    Data Engineering ExpertWe are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining complex data pipelines using Python. Responsibilities Design and Develop Complex Data Pipelines: Collaborate with cross-functional teams to understand data...

  • Senior Data Pipeline Architect

    7 days ago

    Singapore beBeeDataEngineering Full time

    Data Engineering Expert We are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining complex data pipelines using Python. Responsibilities Design and Develop Complex Data Pipelines: Collaborate with cross-functional teams to...

  • **Data Pipeline Architect

    5 days ago

    Singapore beBeeDataEngineer Full time $80,000 - $120,000

    **Senior Data Engineer Position**Our organization is seeking a skilled Senior Data Engineer to develop and maintain our data pipelines. The ideal candidate will have expertise in designing, building, and optimizing data solutions.Key Responsibilities:Enhance the existing data pipeline using industry-standard tools and technologies.Redesign and implement data...

  • Data Pipeline Architect

    5 days ago

    Singapore beBeeData Full time $90,000 - $120,000

    Job Title: Data Engineering Specialist We are seeking a skilled Data Engineer to create and implement data pipelines using AWS services, Databricks, and Informatica IDMC. Key Responsibilities: Develop ETL processes to cleanse, transform, and enrich data using Databricks' Spark capabilities and Informatica IDMC. Monitor and optimize data processing and...

  • Data Pipeline Architect

    1 week ago

    Singapore beBeeDataEngineer Full time

    Job Title We are looking for a skilled Data Engineering professional to lead the development and maintenance of robust and scalable data pipelines. Develop and implement ETL pipelines in Python to power industry models and analytics products. Collaborate with lead analysts to ensure data accuracy, completeness and utility value across multiple sources...

  • Data Pipeline Architect

    1 week ago

    Singapore beBeeData Full time $150,000 - $200,000

    Job DescriptionWe are seeking a talented Senior Data Engineer to join our team. In this role, you will be responsible for designing, developing, and maintaining data pipelines and ETL/ELT processes.Develop maintainable data pipelines using unit and integration testing.Collaborate with data teams to automate deployment and monitoring.Optimize data storage and...