Big Data Engineer

4 weeks ago

Singapur, Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full time

Job Title: Big Data Engineer (Java, Spark, Hadoop)

Location : Singapore

Experience : 7- 12 years

Employment Type : Full-Time

Open to Citizens and SPR only | No Visa sponsorship available

Job Summary

We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep expertise in Java , Apache Spark , and Hadoop ecosystems, and have a strong track record of designing and building scalable, high-performance big data solutions. This role is critical to ensuring robust data processing and delivering clean, actionable data for business insights and advanced analytics.

Key Responsibilities
  • Design, build, and optimize large-scale, distributed data processing systems using Apache Spark , Hadoop , and Java .
  • Lead the development and deployment of data ingestion , ETL/ELT pipelines , and data transformation frameworks .
  • Work with cross-functional teams to gather data requirements and translate them into scalable data solutions.
  • Ensure high performance and reliability of big data systems through performance tuning and best practices.
  • Manage and monitor batch and real-time data pipelines from diverse sources including APIs, databases, and streaming platforms like Kafka .
  • Apply deep knowledge of Java to build efficient, modular, and reusable codebases.
  • Mentor junior engineers, participate in code reviews, and enforce engineering best practices.
  • Collaborate with DevOps teams to build CI/CD pipelines and automate deployment processes.
  • Ensure data governance , security , and compliance standards are maintained.
Required Qualifications
  • 7–12 years of experience in big data engineering or backend data systems.
  • Strong hands-on programming skills in Java ; exposure to Scala or Python is a plus.
  • Proven experience with Apache Spark , Hadoop (HDFS, YARN, MapReduce), and related tools.
  • Solid understanding of distributed computing , data partitioning, and optimization techniques.
  • Experience with data access and storage layers like Hive , HBase , or Impala .
  • Familiarity with data ingestion tools like Apache Kafka , NiFi , Flume , or Sqoop .
  • Comfortable working with SQL for querying large datasets.
  • Good understanding of data architecture , data modeling , and data lifecycle management .
  • Experience with cloud platforms like AWS , Azure , or Google Cloud Platform .
  • Strong problem-solving, analytical, and communication skills.
Preferred Qualifications
  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
  • Experience with streaming data frameworks such as Spark Streaming , Kafka Streams , or Flink .
  • Knowledge of DevOps practices , CI/CD pipelines, and infrastructure as code (e.g., Terraform).
  • Exposure to containerization (Docker) and orchestration (Kubernetes) .
  • Certifications in Big Data technologies or Cloud platforms are a plus.

Please note that this is an equal opportunities employer.

#J-18808-Ljbffr

  • Big Data Engineer

    3 weeks ago

    Singapur, Singapore ALMR CONSULTING PTE. LTD. Full time

    Job Summary We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs. Key Responsibilities...

  • Big Data Engineer

    4 days ago

    Singapur, Singapore Tata Consultancy Services Limited Full time

    Requirements Proven experience as a Big Data Engineer or similar role. Strong proficiency in Apache Spark and Scala programming. Experience with big data technologies such as Hadoop, Hive, Kafka, etc. Familiarity with data warehousing concepts and tools. Knowledge of SQL and NoSQL databases. Excellent problem-solving skills and attention to detail. Strong...

  • Big Data Engineer

    4 days ago

    Singapur, Singapore OCBC Full time

    Who We Are As Singapore’s longest established bank, we have been dedicated to enabling individuals and businesses to achieve their aspirations since 1932. How? By taking the time to truly understand people. From there, we provide support, services, solutions, and career paths that meet their individual needs and desires. Today, we’re on a journey of...

  • Big Data Test Engineer

    3 weeks ago

    Singapur, Singapore Patsnap Full time

    About PatSnap PatSnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable...

  • Big Data Engineer

    4 weeks ago

    Singapur, Singapore Baidu, Inc. Full time

    Build the company's big data warehouse system, including batch and stream data flow construction. In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance. Responsible for data integration and ETL architecture design and development....

  • Big Data Engineer

    3 hours ago

    Singapur, Singapore OCBC company Full time

    You may choose to display a cookie banner on the external site. You must specify the message in the cookie banner and may add a link to a relevant policy. If you are unfamiliar with these requirements, please seek the advice of legal counsel.You are about to enter websites controlled or offered by third parties. OCBC hereby disclaims liability for any...

  • Big Data Support Engineer

    2 days ago

    Singapur, Singapore ADVANCED E-SOLUTIONS PTE. LTD. Full time

    Overview POSITION OVERVIEW : Big Data Support Engineer General Duties and Tasks Skillset Up to 9 years of IT experience & 5+ Years on Teradata or Hadoop Last 3 years of relevant experience in banking/financial services industry Hands-on technologist, strong in SQL, UNIX and Hadoop/Teradata tools and technologies Demonstrable analytical skills with good...

  • Big Data Engineer

    3 weeks ago

    Singapur, Singapore DCS CARD CENTRE PTE. LTD. Full time

    Key Responsibilities Lead the design and implementation of a high-performance, real-time data platform for financial systems, supporting petabyte-scale daily transaction data across ingestion, storage, and computation layers. Architect a cloud-native data warehouse solution on AWS, incorporating Spark and Flink to support both batch and streaming use cases...

  • Big Data Engineer

    3 weeks ago

    Singapur, Singapore ARYAN SOLUTIONS PTE. LTD. Full time

    Experience Hands-on Big Data experience using common open-source components (Hadoop, Hive, Spark, Presto, NiFi, MinIO, K8S, Kafka). Experience in stakeholder management in heterogeneous business/technology organizations. Experience in banking or financial business, with handling sensitive data across regions. Experience in large data migration projects with...

  • Senior Data Engineer

    2 weeks ago

    Singapur, Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Join us to apply for the Senior Data Engineer (Big Data Processing) role at Centre for Strategic Infocomm Technologies (CSIT) . CSIT develops products to advance Singapore's national security interests, including counter-terrorism and computer network defence. We seek talented senior data engineers to lead and develop mission-critical products that identify,...