Data Pipeline Specialist

2 days ago

Singapore beBeeData Full time $80,000 - $140,000
Job Title: Data Pipeline Specialist

Job Description
The primary focus of this role is to design, implement, and maintain efficient data pipelines. This includes integrating data from various sources, optimizing existing pipelines for improved performance and scalability, and ensuring the accuracy and reliability of data used in analytics and reporting.

Key Responsibilities:
  • Data Pipeline Development: Utilize programming languages such as Python or Scala to develop and maintain data pipelines, ensuring they meet the needs of the organization.
  • Data Warehouse Management: Develop and maintain the data warehouse architecture, implementing data modeling techniques to optimize data storage and retrieval.
  • Data Quality Assurance: Implement data quality checks and monitoring systems to ensure the accuracy and reliability of data used in analytics and reporting.
  • Big Data Technologies: Utilize big data technologies such as Hadoop and Spark to process and analyze large volumes of customer data efficiently.
  • Data Governance: Collaborate with stakeholders to implement data governance policies and procedures, ensuring compliance with data privacy regulations and internal data management standards.

Technical Skills:

  • Proficiency in programming languages such as Python or Scala.
  • Experience with ETL tools such as Apache NiFi, Talend, and Informatica.
  • Familiarity with data visualization tools such as Tableau and PowerBI.
  • Understanding of container technologies such as Docker and orchestration tools such as Kubernetes.

Benefits:

  • Opportunity to work with a variety of data technologies.
  • Chance to collaborate with a team of experienced professionals.
  • Flexibility to work on diverse projects.

About This Role
This is an exciting opportunity for individuals who are passionate about working with data and technology. If you have experience in data engineering and are looking for a new challenge, please consider applying for this position.

  • Data Pipeline Specialist

    2 weeks ago

    Singapore beBeeDataPipeline Full time

    Job Title: Data Pipeline SpecialistWe are seeking a skilled professional to lead the development and maintenance of robust data pipelines.Design, build, and maintain scalable data pipelines to ingest, process, and store structured and unstructured data from internal and external sources.Optimize ETL/ELT processes for real-time and batch data...

  • Pipeline Data Engineer

    1 week ago

    Singapore beBeeData Full time $80,000 - $120,000

    Job Title:ETL Specialist">A strong ETL pipeline support engineer is required to ensure the smooth operation of our DevOps team's production pipelines. Key responsibilities will include monitoring and troubleshooting existing pipelines to maintain optimal performance and data reliability.">This role involves working with various technologies such as SQL,...

  • Data Pipeline Architect

    10 hours ago

    Singapore beBeeData Full time $90,000 - $120,000

    Job Title: Data Engineering Specialist We are seeking a skilled Data Engineer to create and implement data pipelines using AWS services, Databricks, and Informatica IDMC. Key Responsibilities: Develop ETL processes to cleanse, transform, and enrich data using Databricks' Spark capabilities and Informatica IDMC. Monitor and optimize data processing and...

  • Data Pipeline Specialist

    1 day ago

    Singapore beBeeMachineLearning Full time $80,000 - $120,000

    Software Engineer for ML Data PipelinesWe are seeking a highly skilled Software Engineer to contribute to our Perception team in Singapore. This role is instrumental in advancing our machine learning (ML) data pipelines.Our large-scale data pipelines play a vital part in efficient end-to-end ML development of on-car and off-car perception solutions. You will...

  • Data Pipeline Specialist

    2 days ago

    Singapore beBeeDataEngineer Full time $80,000 - $120,000

    Job DescriptionWe are seeking a skilled Data Engineer to contribute to the development of robust data pipelines that drive business insights and AI initiatives.This role involves designing, building, testing, and maintaining complex data pipelines and transformation workflows on our data platform.The successful candidate will support data integration and...

  • Data Pipeline Specialist

    2 weeks ago

    Singapore beBeeDataEngineer Full time $100,000 - $150,000

    Job Title: Data EngineerWe are seeking a skilled professional to assume the role of Data Engineer in our organization. The successful candidate will be responsible for identifying relevant data to be gathered and implementing solutions to extract, transform, and load (ETL) the data into databases or data sources.The ideal candidate will have experience in...

  • Data Pipeline Specialist

    1 week ago

    Singapore beBeeEngineering Full time $140,000 - $170,000

    Job Title: Lead Data EngineerWe are seeking an accomplished data engineer to spearhead the design, development and maintenance of scalable data pipelines and ETL solutions.Collaborate with cross-functional teams to ensure data quality, scalability and alignment with business and technical requirements.Design, develop, test and maintain robust ETL pipelines...

  • Data Pipeline Specialist

    2 weeks ago

    Singapore beBeeDataEngineer Full time $80,000 - $100,000

    Job Title: Data EngineerWe are seeking a skilled and experienced data engineer to join our team.The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support the processing and analysis of clinical study and digital device sensor data.

  • Data Pipeline Specialist

    6 days ago

    Singapore beBeeDataEngineer Full time $90,000 - $120,000

    Job TitleData Engineer (Manager) RoleWe are looking for a highly skilled Data Engineer to join our team in Singapore. The successful candidate will be responsible for designing, building, and maintaining efficient data pipelines, collaborating with data scientists and stakeholders, and ensuring data integrity and security.About the JobThis is a full-time...

  • Data Pipeline Architect

    1 week ago

    Singapore beBeeData Full time $80,000 - $120,000

    Job Title: Data Analyst SpecialistThe primary function of this role is to design, build, maintain and optimize data pipeline architecture.Collaborate with our team of analysts and scientists to optimise extraction, transformation and loading of data from various sources using SQL and Big Data technologies.Evaluate data analytics technologies to recommend...