Big Data Engineer

1 day ago

Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full time

Job Title: Big Data Engineer (Java, Spark, Hadoop)
Location : Singapore
Experience : 7- 12 years
Employment Type : Full-Time
Open to Citizens and SPR only | No Visa sponsorship available
Job Summary
We are looking for a
Senior Big Data Engineer
with
7–12 years of experience
to join our growing data engineering team. The ideal candidate will bring deep expertise in
Java ,
Apache Spark , and
Hadoop
ecosystems, and have a strong track record of designing and building scalable, high-performance big data solutions. This role is critical to ensuring robust data processing and delivering clean, actionable data for business insights and advanced analytics.
Key Responsibilities
Design, build, and optimize
large-scale, distributed data processing systems
using
Apache Spark ,
Hadoop , and
Java .
Lead the development and deployment of
data ingestion ,
ETL/ELT pipelines , and
data transformation frameworks .
Work with cross-functional teams to gather data requirements and translate them into scalable data solutions.
Ensure high performance and reliability of big data systems through performance tuning and best practices.
Manage and monitor
batch and real-time data pipelines
from diverse sources including APIs, databases, and streaming platforms like
Kafka .
Apply deep knowledge of
Java
to build efficient, modular, and reusable codebases.
Mentor junior engineers, participate in code reviews, and enforce engineering best practices.
Collaborate with DevOps teams to build CI/CD pipelines and automate deployment processes.
Ensure
data governance ,
security , and
compliance
standards are maintained.
Required Qualifications
7–12 years of experience
in big data engineering or backend data systems.
Strong hands-on programming skills in
Java ; exposure to
Scala
or
Python
is a plus.
Proven experience with
Apache Spark ,
Hadoop
(HDFS, YARN, MapReduce), and related tools.
Solid understanding of
distributed computing , data partitioning, and optimization techniques.
Experience with data access and storage layers like
Hive ,
HBase , or
Impala .
Familiarity with data ingestion tools like
Apache Kafka ,
NiFi ,
Flume , or
Sqoop .
Comfortable working with
SQL
for querying large datasets.
Good understanding of
data architecture ,
data modeling , and
data lifecycle management .
Experience with cloud platforms like
AWS ,
Azure , or
Google Cloud Platform .
Strong problem-solving, analytical, and communication skills.
Preferred Qualifications
Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
Experience with
streaming data frameworks
such as
Spark Streaming ,
Kafka Streams , or
Flink .
Knowledge of
DevOps practices , CI/CD pipelines, and infrastructure as code (e.g., Terraform).
Exposure to
containerization (Docker)
and
orchestration (Kubernetes) .
Certifications in
Big Data technologies
or
Cloud platforms
are a plus.
Please note that this is an equal opportunities employer.
#J-18808-Ljbffr

  • Data Engineer

    6 days ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$5,000 - S$9,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake yarn Oracle Shell Script CI Shell UNIX Presto Java MSSQL Airflow Spark Linux Python Astek is proposing an opportunity for **Data Engineer** (Big Data) to support our project based in**...

  • Data Engineer

    6 days ago

    Singapore TALENTSIS PTE. LTD. Full time

    We are looking for a skilled **Data Engineer**with a focus on **Big Data**to design, develop, and manage large-scale data processing systems. If you're passionate about working with big data technologies and driving impactful solutions, we want to hear from you. **Key Responsibilities**: - Build and maintain big data pipelines using technologies like...

  • Big Data Engineer

    7 days ago

    Singapore SAKSOFT PTE LIMITED Full time

    Experience: 9+ Years Role: Big Data Engineer Skills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting(Good to have). Design...

  • Big Data Engineer

    4 days ago

    Singapore UNISON Group Full time $80,000 - $120,000 per year

    We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...

  • Big Data Engineer

    3 weeks ago

    Singapore Unison Consulting Full time

    Get AI-powered advice on this job and more exclusive features. We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing,...

  • Big Data Engineer

    3 weeks ago

    Singapore AXPARA SOLUTIONS PTE. LTD. Full time

    Job Description: We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and...

  • Big Data Platform Engineer

    1 week ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    **SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...

  • Big Data Engineering Lead

    3 weeks ago

    Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full time

    We're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation.Key Responsibilities: Design and develop...

  • Principal Big Data Engineer

    7 days ago

    Singapore QUESSCORP HOLDINGS PTE. LTD. Full time

    **Job Description**: - Design and implement scalable data pipelines to collect, process, and store large volumes of structured and unstructured data. - Ensure data quality, integrity, and consistency across various data sources. - Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that...

  • Platform Engineer – Big Data

    3 weeks ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesWe are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive. Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets. Maintain and fine-tune...