Big Data Engineer Specialist

2 days ago


Singapore beBeeDataEngineering Full time $80,000 - $120,000
Big Data Engineer Specialist

We are seeking a skilled Big Data Engineer to join our team. The successful candidate will be responsible for designing, maintaining and optimizing large-scale distributed systems.

Key Responsibilities:

  • Design and implement ETL/ELT pipelines using Spark for batch and streaming data.
  • Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability.
  • Develop and maintain Hive data models, partitions and queries for analytics and reporting.
  • Improve query and pipeline performance through tuning, partitioning, bucketing and caching.
  • Ensure data quality, governance and security across the big data ecosystem.
  • Collaborate with data scientists, analysts and architects to support advanced analytics and BI.

Required Skills and Qualifications:

  • Experience in data engineering or big data development.
  • Strong hands-on experience in Spark (Core, SQL, Streaming).
  • Good understanding of Hadoop (HDFS, YARN) architecture.
  • Expertise in Hive data modeling, query optimization and performance tuning.
  • Experience with cluster troubleshooting, monitoring and scaling.
  • Knowledge of data governance and security frameworks is a plus.
  • Familiarity with cloud big data platforms (AWS EMR, Azure HDInsight, or GCP Dataproc) preferred.

Benefits:

This role offers a competitive salary, comprehensive benefits package, and opportunities for professional growth and development.

Others:

The ideal candidate will have a strong passion for technology and a commitment to delivering high-quality results. If you are a motivated and detail-oriented individual who is passionate about big data engineering, we encourage you to apply.



  • Singapore beBeeData Full time $90,000 - $120,000

    Job Opportunity: Become a Big Data Engineer and Contribute to Large-Scale System DevelopmentThe data management team at our company is focused on creating solutions that handle the entire big data pipeline, from ingestion and integration to development, cataloging, security, and governance. Our mission is to design, build, optimize, and scale one of the...

  • Big Data Engineer

    7 days ago


    Singapore beBeeDataEngineering Full time $80,000 - $120,000

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing complex data pipelines using Apache Spark.Main Responsibilities:Design and optimize data pipelines using Apache SparkDevelop and maintain Hive tables, queries, and...


  • Singapore MSD Full time

    **Specialist, Big Data Engineering** - Opportunity to **be a part of IT Engineering, Development & Integration organization in Singapore!**: - ** Based in Singapore, **the regional hub for Asia Pacific (AP) and top-ranked biopharmaceutical company on The Straits Times and Statista’s list of Best Employers in Singapore for two consecutive years (2020,...


  • Singapore beBeeData Full time $80,000 - $120,000

    Job Title: Big Data ArchitectThis is a critical role that requires the ability to design and implement data engineering solutions that meet analytical needs. The ideal candidate will have experience in big data environment management, including Cloudera Data Platform.Responsibilities:Develop and maintain data ingestion and processing jobs.Design and...

  • Data Architect

    4 days ago


    Singapore beBeeData Full time $120,000 - $150,000

    Big Data Platform SpecialistWe are seeking a highly skilled Big Data Platform Specialist to join our team. As a key member, you will design and implement big data platforms built on Hadoop, Spark, and Hive.About the RoleDesign and implement big data platforms using Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage...

  • Big Data Engineer

    7 days ago


    Singapore IITMATRIX Full time

    We are looking for a skilled **Big Data Engineer** to join our dynamic team. You will be responsible for designing, developing, and optimizing data solutions within the Big Data ecosystem. This role involves working with large datasets, ensuring high performance at scale, and collaborating with cross-functional teams to deliver data-driven insights and...

  • Big Data Specialist

    6 days ago


    Singapore beBeeDataEngineer Full time $100,000 - $140,000

    Data Engineer Job OpportunityWe are seeking an experienced and skilled Data Engineer to join our team. Our ideal candidate will have a strong background in data engineering, big data technologies, and programming skills.The successful applicant will be responsible for designing, building, and optimizing scalable data pipelines using Scala and Hadoop...


  • Singapore beBeeSystem Full time $80,000 - $120,000

    Job Title:Data System Stability SpecialistOverview:The Data Platform Team is responsible for developing products that cover the entire lifecycle of data pipeline, including data ingestion and integration, data development, data catalog, data security and governance. These products support various businesses, so data engineers and scientists can greatly boost...

  • Big Data Engineer

    4 days ago


    Singapore AlgoriX Technology Pte. Ltd. Full time

    **Responsibilities** The Big Data Engineer is responsible for analyzing big data and optimizing the performance of our online advertising delivery system. They are also responsible for the research and development of the advertising system’s offline and real-time data streams. **Requirements**: - Bachelor’s degree or above, majoring in Computer...

  • Big Data Engineer

    2 days ago


    Singapore INCOME INSURANCE LIMITED Full time

    Responsible for data pipeline setup and data transformation - Implementation including loading from disparate data sets, preprocessing data. - Scope and deliver various Big Data solutions - Ability to design solutions independently based on high-level architecture. - Maintain the production systems (Kafka, Hadoop, Elasticsearch, RDBMS and No-SQL) -...