Big Data Solutions Developer

1 week ago


Singapore beBeeDataEngineer Full time $160,000 - $220,000
Job Overview

We are seeking a skilled Data Engineer to develop innovative data solutions using cutting-edge technology.

Key Responsibilities:
  • Design, implement and maintain large-scale data pipelines with DevOps tools like Jenkins, GitLab CI/CD, and containerization techniques with Docker and Kubernetes.
  • Integrate real-time data feeds with Apache Kafka and leverage distributed SQL engines like Presto and Trino for efficient data processing.
  • Work with cloud-based object storage solutions like Amazon S3 and experience with cloud migration, including assessment, planning, execution and validation.
  • Develop disaster recovery setup including backup and restore processes, replication and failover mechanisms.
  • Maintain expertise in Python programming language and stay up-to-date with emerging technologies.
Required Skills:
  • Apache Spark and big data processing.
  • Data science platforms.
  • Ansible Playbooks to automate infrastructure provisioning, configuration and deployment.
  • Terraform to manage and provision cloud infrastructure resources.
About the Role

This is an exciting opportunity to work with a leading IT services company that helps clients navigate digital transformation.


  • Big Data Developer

    1 week ago


    Singapore Zone IT Solutions Full time

    We are looking for Big Data Developers in the vibrant city of Singapore. This is a fantastic opportunity for someone who is passionate about big data and wants to take their career to new heights. **Requirements**: - Minimum of 5 years of experience as a Big Data Developer - Strong knowledge and experience with Big Data technologies such as Hadoop, Spark,...

  • Big Data Developer

    15 hours ago


    Singapore DADACONSULTANTS PTE. LTD. Full time

    **Responsibilities** **1、**Design and develop scalable, high-performance data processing systems using Hadoop, Flink, and other Big Data technologies. 2、Develop and maintain data pipelines for data ingestion, processing, and analysis. 3、Design and implement data models to optimize data storage and retrieval efficiency. 4、Collaborate with...


  • Singapore beBeeData Full time $80,000 - $120,000

    Job Title: Big Data Solutions ExpertAre you passionate about leveraging cutting-edge technology to drive business growth? Do you have a knack for developing and deploying complex data engineering pipelines?As a key member of our Professional Services team, you will work closely with clients to design, develop, and implement innovative big data solutions...


  • Singapore beBeeSolution Full time

    Job SummaryWe are seeking a highly skilled Big Data Solution Expert to join our team. In this role, you will be responsible for designing and implementing Big Data solutions tailored to customer business scenarios and technical requirements.Your Key Responsibilities:Analyze customers' needs and pain points regarding Big Data products and solutions.Recommend...

  • Big Data Developer

    4 days ago


    Singapore ALMR CONSULTING PTE. LTD. Full time $90,000 - $120,000 per year

    Responsibilities Designing, building, and maintaining systems that handle large volumes of data, enabling businesses to extract valuable insights and make data-driven decisions Creating scalable and efficient data pipelines, implementing data models, and integrating various data sources. Developing and deploying data processing applications using Big Data...


  • Singapore beBeeDataMining Full time $80,000 - $120,000

    Job DescriptionDevelop and implement large-scale data platforms to ensure stability, high availability, and scalability of data services. Design and optimize functionalities of big data components, including offline/real-time data processing, data governance, self-service analytics reports, and OLAP query engines.Responsibilities:Design and develop data...


  • Singapore beBeeDataExpert Full time $175,831 - $242,439

    Senior Big Data ExpertWe are seeking a seasoned Senior Big Data Expert to join our team.As a key member of our Professional Services Team, you will work closely with clients on short to medium-term engagements, solving complex big data problems using Apache Spark and the Databricks Data Intelligence Platform.With in-depth expertise in Apache Spark and data...

  • Big Data Developer

    15 hours ago


    Singapore NITYO 3P SOLUTIONS PTE. LTD. Full time

    **Job Description & Requirements** - Developing and optimising ETL (Extract, Transform, Load) processes to ingest and transform large volumes of data from multiple sources. - Must have exp in investment banking ,payment and transaction banking domain. - Proficiency in programming languages and scripting (e.g., Java, Scala, Python, SQL) for data processing...


  • Singapore beBeeDataEngineer Full time $120,000 - $140,000

    Job OverviewThis role involves designing, developing, and maintaining large-scale data ingestion and processing jobs in a big data environment. The ideal candidate will have extensive experience with Cloudera Data Platform and be skilled in Python, Pyspark, and ETL tools like Informatica.Responsibilities:


  • Singapore beBeeTechnical Full time

    Job DescriptionAs a Resident Solutions Architect (RSA), you will be part of the Professional Services team and work with clients on short to medium term customer engagements solving their big data problems using Apache Spark and the Databricks Data Intelligence Platform.You will be in a customer-facing role that requires deep hands-on expertise in Apache...