Data Pipeline Architect

1 week ago

Singapore beBeeData Full time $90,000 - $120,000

Job Title: Data Engineering Specialist

We are seeking a skilled Data Engineer to create and implement data pipelines using AWS services, Databricks, and Informatica IDMC.

Key Responsibilities:

  • Develop ETL processes to cleanse, transform, and enrich data using Databricks' Spark capabilities and Informatica IDMC.
  • Monitor and optimize data processing and query performance in both AWS and Databricks environments.
  • Implement security best practices and data encryption methods to protect sensitive data in both AWS and Databricks.
  • Implement automation for routine tasks using AWS services like AWS Step Functions, AWS Lambda, Databricks Jobs, and Informatica IDMC.
  • Maintain clear and comprehensive documentation of data infrastructure, pipelines, and configurations.

Requirements:

  • Bachelor's or master's degree in computer science, data engineering, or a related field.
  • Minimum 4 years of experience in data engineering with expertise in AWS services, Databricks, and/or Informatica IDMC.
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Strong knowledge of SQL and NoSQL databases.
  • Familiarity with data modeling and schema design.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.

  • Data Pipeline Architect

    7 days ago

    Singapore beBeeDataPipeline Full time $90,000 - $120,000

    About the Role:We are seeking a highly skilled Data Pipeline Architect to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing efficient data pipelines that meet the needs of our organization.Key Responsibilities:Design and develop scalable data pipelines using Python and AWS services (S3,...

  • Data Pipeline Architect

    2 days ago

    Singapore beBeeDataPipeline Full time

    About the Role: We are seeking a highly skilled Data Pipeline Architect to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing efficient data pipelines that meet the needs of our organization. Key Responsibilities: Design and develop scalable data pipelines using Python and AWS services...

  • Data Pipeline Architect

    2 weeks ago

    Singapore beBeeDataEngineer Full time $120,000 - $180,000

    Job Description:We are seeking a Data Engineering professional to design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration. The ideal candidate will have expertise in collaborating with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment.The...

  • Data Pipeline Architect

    2 weeks ago

    Singapore beBeeSoftwareEngineering Full time

    Key Role Responsibilities We seek a Software Engineer to work on multiple fronts, building and optimizing data pipelines for AI-driven initiatives. Design scalable and efficient workflows in support of analytics projects. Utilize Copilot Studio for AI-driven application development and automation. Implement AI Foundry solutions on Microsoft Azure,...

  • Senior Data Pipeline Architect

    2 weeks ago

    Singapore beBeeDataEngineering Full time

    Data Engineering Expert We are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining complex data pipelines using Python. Responsibilities Design and Develop Complex Data Pipelines: Collaborate with cross-functional teams to...

  • **Data Pipeline Architect

    1 week ago

    Singapore beBeeDataEngineer Full time $80,000 - $120,000

    **Senior Data Engineer Position**Our organization is seeking a skilled Senior Data Engineer to develop and maintain our data pipelines. The ideal candidate will have expertise in designing, building, and optimizing data solutions.Key Responsibilities:Enhance the existing data pipeline using industry-standard tools and technologies.Redesign and implement data...

  • Data Pipeline Architect

    6 days ago

    Singapore beBeeDataEngineer Full time $100,000 - $130,000

    Job Title: Data EngineerWe are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will design, develop, and optimize data pipelines using AWS services.Responsibilities:Design and implement ETL/ELT pipelines using AWS Glue, Athena, S3, Redshift, and Iceberg.Implement monitoring and alerting mechanisms for data workflows to ensure...

  • Data Pipeline Architect

    2 weeks ago

    Singapore beBeeDataEngineer Full time

    Job Title We are looking for a skilled Data Engineering professional to lead the development and maintenance of robust and scalable data pipelines. Develop and implement ETL pipelines in Python to power industry models and analytics products. Collaborate with lead analysts to ensure data accuracy, completeness and utility value across multiple sources...

  • Data Pipeline Architect

    2 weeks ago

    Singapore beBeeData Full time $150,000 - $200,000

    Job DescriptionWe are seeking a talented Senior Data Engineer to join our team. In this role, you will be responsible for designing, developing, and maintaining data pipelines and ETL/ELT processes.Develop maintainable data pipelines using unit and integration testing.Collaborate with data teams to automate deployment and monitoring.Optimize data storage and...

  • Leading Data Pipeline Architect

    6 days ago

    Singapore beBeeDataEngineer Full time $90,000 - $120,000

    Job Title: Senior Data EngineerWe are looking for a skilled Senior Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing and implementing data pipelines using industry-standard tools and mechanisms.Responsibilities:Enhance the existing data pipeline using industry-standard tools and mechanisms.Redesign...