Big Data Engineer

7 days ago

Singapur, Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full time

Job Title: Big Data Engineer (Java, Spark, Hadoop)

Location : Singapore

Experience : 7- 12 years

Employment Type : Full-Time

Open to Citizens and SPR only | No Visa sponsorship available

Job Summary

We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep expertise in Java , Apache Spark , and Hadoop ecosystems, and have a strong track record of designing and building scalable, high-performance big data solutions. This role is critical to ensuring robust data processing and delivering clean, actionable data for business insights and advanced analytics.

Key Responsibilities
  • Design, build, and optimize large-scale, distributed data processing systems using Apache Spark , Hadoop , and Java .
  • Lead the development and deployment of data ingestion , ETL/ELT pipelines , and data transformation frameworks .
  • Work with cross-functional teams to gather data requirements and translate them into scalable data solutions.
  • Ensure high performance and reliability of big data systems through performance tuning and best practices.
  • Manage and monitor batch and real-time data pipelines from diverse sources including APIs, databases, and streaming platforms like Kafka .
  • Apply deep knowledge of Java to build efficient, modular, and reusable codebases.
  • Mentor junior engineers, participate in code reviews, and enforce engineering best practices.
  • Collaborate with DevOps teams to build CI/CD pipelines and automate deployment processes.
  • Ensure data governance , security , and compliance standards are maintained.
Required Qualifications
  • 7–12 years of experience in big data engineering or backend data systems.
  • Strong hands-on programming skills in Java ; exposure to Scala or Python is a plus.
  • Proven experience with Apache Spark , Hadoop (HDFS, YARN, MapReduce), and related tools.
  • Solid understanding of distributed computing , data partitioning, and optimization techniques.
  • Experience with data access and storage layers like Hive , HBase , or Impala .
  • Familiarity with data ingestion tools like Apache Kafka , NiFi , Flume , or Sqoop .
  • Comfortable working with SQL for querying large datasets.
  • Good understanding of data architecture , data modeling , and data lifecycle management .
  • Experience with cloud platforms like AWS , Azure , or Google Cloud Platform .
  • Strong problem-solving, analytical, and communication skills.
Preferred Qualifications
  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
  • Experience with streaming data frameworks such as Spark Streaming , Kafka Streams , or Flink .
  • Knowledge of DevOps practices , CI/CD pipelines, and infrastructure as code (e.g., Terraform).
  • Exposure to containerization (Docker) and orchestration (Kubernetes) .
  • Certifications in Big Data technologies or Cloud platforms are a plus.

Please note that this is an equal opportunities employer.

#J-18808-Ljbffr

  • Big Data Platform Engineer

    3 weeks ago

    Singapur, Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Join to apply for the Big Data Platform Engineer role at Centre for Strategic Infocomm Technologies (CSIT) 1 week ago Be among the first 25 applicants Join to apply for the Big Data Platform Engineer role at Centre for Strategic Infocomm Technologies (CSIT) Data processing is an essential part of national security in the modern world. As an engineer in...

  • Big Data Engineer

    7 days ago

    Singapur, Singapore Baidu, Inc. Full time

    Build the company's big data warehouse system, including batch and stream data flow construction. In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance. Responsible for data integration and ETL architecture design and development....

  • Big Data Engineer

    2 weeks ago

    Singapur, Singapore Helius Technologies Pte Ltd Full time

    Big Data Engineer Job Requirement: 5 years of hands on work experience in Hadoop, Scala, Pyspark and Python. Work with Hadoop Distributed File System (HDFS) to manage and store large datasets Utilize tools like Hive, HBase, and Pig to process data in Hadoop Set up and manage data pipelines to extract, transform, and load (ETL) large datasets Develop and...

  • Big Data Engineer

    2 days ago

    Singapur, Singapore DCS CARD CENTRE PTE. LTD. Full time

    Key Responsibilities Lead the design and implementation of a high-performance, real-time data platform for financial systems, supporting petabyte-scale daily transaction data across ingestion, storage, and computation layers. Architect a cloud-native data warehouse solution on AWS, incorporating Spark and Flink to support both batch and streaming use cases...

  • Lead Big Data Engineer

    3 weeks ago

    Singapur, Singapore GREAT EASTERN Full time

    Job Number: Lead Big Data Engineer (Job Number: WW ) About the JobWe are seeking a skilled and detail-oriented Data Engineer to design, develop, and maintain robust data pipelines and ETL solutions. This role involves working closely with cross-functional teams to ensure data quality, scalability, and alignment with business and technical requirements....

  • Staff Platform Engineer

    3 weeks ago

    Singapur, Singapore Centre for Strategic Infocomm Technologies Full time

    CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of operations, including but not limited to Counter-terrorism and Computer NetworkDefence. We are looking for talented Senior Big Data Platform Staff Engineer. Join the awesome CSIT family and use cutting-edge technologies to protect the...

  • Staff Platform Engineer

    3 weeks ago

    Singapur, Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Join to apply for the Staff Platform Engineer - Big Data Platform Management role at Centre for Strategic Infocomm Technologies (CSIT) Continue with Google Continue with Google 1 month ago Be among the first 25 applicants Join to apply for the Staff Platform Engineer - Big Data Platform Management role at Centre for Strategic Infocomm Technologies (CSIT) ...

  • Big Data Engineer, Manager

    2 weeks ago

    Singapur, Singapore OCBC Full time

    Overview As Singapore’s longest established bank, we have been dedicated to enabling individuals and businesses to achieve their aspirations since 1932. Today, we’re on a journey of transformation, leveraging technology and creativity to become a future-ready learning organisation. Our strategic ambition is to be Asia’s leading financial services...

  • Assistant Big Data Development Engineer, 2026 Graduate

    3 weeks ago

    Singapur, Singapore Anker Innovations LTD Full time

    Join to apply for the Assistant Big Data Development Engineer, 2026 Graduate role at Anker Innovations LTD . Responsibilities Build data warehouses and perform data analysis based on business requirements, leveraging big data components Research cutting-edge data mining technologies in the big data field, and apply relevant techniques to real business...

  • AI-Driven Big Data Engineer

    4 days ago

    Singapur, Singapore Pixalate, Inc Full time

    AI- Driven Big Data Engineer Employment Type: Full-TimeLocation : Remote, SingaporeLevel: Entry to Mid Level (PhD Required) Bridge Cutting-Edge AI Research with Petabyte-Scale Data Systems Pixalate is an online trust and safety platform that protects businesses, consumers and children from deceptive, fraudulent and non-compliant mobile, CTV apps and...