Large Scale Data Engineering Professional

1 day ago


Singapore beBeeDataEngineering Full time

Large Scale Data Engineering Expert

We are seeking an experienced Large Scale Data Engineering Expert to join our team. As a key member of our team, you will play a vital role in designing and maintaining large-scale distributed systems.

The ideal candidate will have hands-on experience with Spark (Core, SQL, Streaming), a good understanding of Hadoop (HDFS, YARN) architecture, and expertise in Hive data modeling, query optimization, and performance tuning. Additionally, experience with cluster troubleshooting, monitoring, and scaling is essential.

You will collaborate with data scientists, analysts, and architects to support advanced analytics and business intelligence. Your responsibilities will include improving query and pipeline performance through tuning, partitioning, bucketing, and caching, ensuring data quality, governance, and security across the big data ecosystem.

  • Familiarity with cloud big data platforms such as AWS EMR, Azure HDInsight, or GCP Dataproc is highly desirable

In this role, you will work on a range of projects, from developing ETL/ELT pipelines using Spark for batch and streaming data, to managing and optimizing Hadoop clusters for scalability and reliability. If you have a strong passion for working with large-scale data systems and want to be part of a dynamic team, we encourage you to apply for this exciting opportunity.



  • Singapore beBeeDataEngineering Full time $120,000 - $180,000

    Large Scale Data Engineering ExpertWe are seeking an experienced Large Scale Data Engineering Expert to join our team. As a key member of our team, you will play a vital role in designing and maintaining large-scale distributed systems.The ideal candidate will have hands-on experience with Spark (Core, SQL, Streaming), a good understanding of Hadoop (HDFS,...


  • Singapore beBeeDataEngineer Full time

    As a senior data engineer, you will be responsible for designing and developing large-scale data pipelines that meet the organization's needs. This involves collaborating with cross-functional teams to understand business requirements and ensuring the maintainability of these systems through rigorous testing. Key Skills and Qualifications 8+ years of...


  • Singapore beBeeData Full time $120,000 - $180,000

    We are seeking a skilled Big Data Engineer to join our E-commerce Recommendation Infrastructure team.Job DescriptionThis role involves designing and implementing large-scale recommendation systems, ensuring high-performance storage and computing systems, and troubleshooting production issues. You will work closely with applied machine learning engineers to...


  • Singapore beBeeData Full time $80,000 - $120,000

    Software Engineering Opportunity">This role is responsible for crafting and implementing a storage solution for offline data in the recommendation system, catering to over a billion users.The primary objectives are to guarantee system reliability, uninterrupted service, and seamless performance. The team aims to create a storage and computing infrastructure...


  • Singapore beBeeDataEngineer Full time $90,000 - $120,000

    Senior Data EngineerAs a Senior Data Engineer, you will play a critical role in designing and implementing large-scale data processing and transformation pipelines in our Data Platform team. Our goal is to build a scalable compute platform that enables various teams across the company to access data, extract meaningful metrics, and perform ad-hoc...


  • Singapore beBeeDataWarehouse Full time $80,000 - $120,000

    Unlock Your Potential as a Data Warehouse EngineerAbout the RoleWe are seeking highly skilled and motivated individuals to join our team as Data Warehouse Engineers. In this role, you will be responsible for designing, building, and maintaining large-scale data warehouses that cater to batch and streaming data.The successful candidate will have a solid...


  • Singapore beBeeDataEngineer Full time $90,000 - $120,000

    Are you an accomplished data professional looking for a new challenge?Our ideal candidate will be responsible for architecting and developing large-scale data pipelines that meet our business needs.Design, develop, and maintain complex data systems using cutting-edge technologies.Collaborate with cross-functional teams to understand requirements and deliver...


  • Singapore beBeeData Full time

    Software Engineering Opportunity "> This role is responsible for crafting and implementing a storage solution for offline data in the recommendation system, catering to over a billion users. The primary objectives are to guarantee system reliability, uninterrupted service, and seamless performance. The team aims to create a storage and computing...


  • Singapore beBeeData Full time

    Software Engineering Opportunity "> This role is responsible for crafting and implementing a storage solution for offline data in the recommendation system, catering to over a billion users. The primary objectives are to guarantee system reliability, uninterrupted service, and seamless performance. The team aims to create a storage and computing...


  • Singapore beBeeDataArchitect Full time $120,000 - $250,000

    Job TitleWe are seeking a highly skilled professional to join our E-commerce Recommendation team as a Data Architect.You will design and implement robust offline data architecture for large-scale recommendation systems, working closely with applied machine learning engineers.Your focus will be on ensuring stability and high availability of the production...