Current jobs related to Expert Data Engineer - Singapore - beBeeDataEngineering

  • Systems Optimization Expert

    5 days ago

    Singapore beBee Engineer Full time $80,000 - $120,000

    Role Description:">">We are seeking an Engineer to join our team, responsible for monitoring and maintaining critical information-communication systems.">">About the Role:">As a key member of our team, you will work alongside fellow engineers to ensure the reliability and functionality of our communication systems. Your expertise in advanced technologies...

  • Data Engineering Expert

    2 weeks ago

    Singapore beBeeDataEngineering Full time

    Job Title: Data Engineering Expert We are seeking a highly skilled Data Engineering expert to support our organization's data management initiatives. The ideal candidate will have at least 8 years of experience in software or data engineering with proficiency in Python programming language. Key Responsibilities: Strong experience in unit and...

  • Data Engineer

    1 week ago

    Singapore NTT Data Singapore Full time

    **The primary responsibilities**: - Lead architecture design, develop, document, and implement end-to-end data pipelines and data-driven solutions. - Define roadmap to transform data architecture focusing on scalability, performance, and stability for the entire data lifecycle; - Build data flow for data acquisition, aggregation, and modelling, using both...

  • Data Engineering Expert

    1 week ago

    Singapore beBeeDataEngineering Full time $80,000 - $150,000

    Job Title: Data Engineering ExpertAs a seasoned data engineer, you will be responsible for designing and implementing efficient data processing pipelines using Apache Spark and Hive. Your expertise in SQL query optimization and data quality assurance will ensure seamless data flows across systems.Key Responsibilities:Design and optimize complex data...

  • Data Engineering Expert

    6 days ago

    Singapore beBeeDataEngineering Full time $90,000 - $120,000

    Job Title:Data Engineering Expert Job Description:We are seeking a highly skilled Data Engineer to join our team.The ideal candidate will have experience with designing, developing and deploying data pipelines and architectures.They should be proficient in programming languages such as Python, SQL and Hadoop.A strong understanding of big data technologies...

  • Data Engineering Expert

    7 days ago

    Singapore beBeeEngineering Full time $80,000 - $120,000

    Job Opportunity:We are seeking a skilled Data Engineering Expert to join our team.About the Role:Craft, test and validate data pipelines for seamless deployments.Verify data integrity and completeness post-deployments.Troubleshoot pipeline issues efficiently.Implement fixes and document root causes of problems encountered.Enhance pipeline performance and...

  • Network Engineering Specialist

    2 weeks ago

    Singapore NTT DATA Full time

    **Req ID**: 133019 We are currently seeking a Network Engineering Specialist to join our team in Singapore, Central Singapore (SG-01), Singapore (SG). Job Title: Network Engineering Specialist Summary: The Networking Engineering Specialist will be responsible for production and non-production Device Design/Policy/functionality for service implementation....

  • Expert Cloud Data Engineer

    1 week ago

    Singapore beBeeData Remote Work Freelance Full time $160,000 - $200,000

    Cloud Data Engineering ExpertWe are seeking an expert in cloud data engineering to design, develop, and maintain large-scale data processing systems. This role requires a strong understanding of cloud-based data services, including AWS and Databricks.The ideal candidate will have experience with data pipelines, data warehousing, and ETL processes, as well as...

  • Expert Cloud Data Engineer

    7 days ago

    Singapore beBeeData Full time

    Cloud Data Engineering Expert We are seeking an expert in cloud data engineering to design, develop, and maintain large-scale data processing systems. This role requires a strong understanding of cloud-based data services, including AWS and Databricks. The ideal candidate will have experience with data pipelines, data warehousing, and ETL processes, as...

  • Expert Cloud Data Engineer

    4 days ago

    Singapore beBeeData Full time

    Cloud Data Engineering Expert We are seeking an expert in cloud data engineering to design, develop, and maintain large-scale data processing systems. This role requires a strong understanding of cloud-based data services, including AWS and Databricks. The ideal candidate will have experience with data pipelines, data warehousing, and ETL processes, as...

Expert Data Engineer

2 weeks ago

Singapore beBeeDataEngineering Full time $100,000 - $150,000
Big Data Engineering Expert

We are seeking a highly skilled Big Data Engineering expert to design, develop and maintain scalable data pipelines and systems that handle large datasets.

The ideal candidate will have expertise in Scala, SQL and Hadoop as well as strong analytical skills and excellent communication skills. They will collaborate with cross-functional teams to deliver high-quality solutions for data storage, transformation and analytics.

Main Responsibilities
  • Data Pipeline Development: Design, build and optimize scalable data pipelines using Scala and Hadoop frameworks.
  • ETL Process Implementation: Implement ETL processes to ingest, transform and store data from various sources.
  • SQL Query Optimization: Write and optimize complex SQL queries for efficient data retrieval and transformation.
  • Troubleshooting and Performance Improvement: Troubleshoot and resolve performance issues in queries and data workflows.
  • Hadoop Infrastructure Management: Manage and maintain Hadoop-based data infrastructure including HDFS, Hive and related components.
  • Distributed Environment Optimization: Monitor system performance and optimize resource utilization in a distributed environment.
  • Collaboration and Technical Guidance: Work closely with data analysts, data scientists and business stakeholders to understand requirements and translate them into technical solutions. Provide technical guidance and promote best practices for data engineering within the team.
Requirements
  • 4-6 Years of Experience: 4-6 years of experience in data engineering, big data technologies or a similar role.
  • Scala Programming Expertise: Expertise in Scala programming and functional programming concepts.
  • Strong SQL Skills: Strong SQL skills with a focus on query optimization and database design.
  • Hadoop Ecosystem Tools: Hands-on experience with Hadoop ecosystem tools (HDFS, Hive, YARN, MapReduce).
  • Additional Big Data Tools: Familiarity with additional big data tools like Spark, Kafka or Flink is a plus.