Big Data Engineer

2 days ago

Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full time

Job Title: Big Data Engineer (Java, Spark, Hadoop)Location : Singapore Experience : 7- 12 years Employment Type : Full-Time Open to Citizens and SPR only | No Visa sponsorship available Job Summary We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep expertise in Java , Apache Spark , and Hadoop ecosystems, and have a strong track record of designing and building scalable, high-performance big data solutions. This role is critical to ensuring robust data processing and delivering clean, actionable data for business insights and advanced analytics. Key Responsibilities Design, build, and optimize large-scale, distributed data processing systems using Apache Spark , Hadoop , and Java . Lead the development and deployment of data ingestion , ETL/ELT pipelines , and data transformation frameworks . Work with cross-functional teams to gather data requirements and translate them into scalable data solutions. Ensure high performance and reliability of big data systems through performance tuning and best practices. Manage and monitor batch and real-time data pipelines from diverse sources including APIs, databases, and streaming platforms like Kafka . Apply deep knowledge of Java to build efficient, modular, and reusable codebases. Mentor junior engineers, participate in code reviews, and enforce engineering best practices. Collaborate with DevOps teams to build CI/CD pipelines and automate deployment processes. Ensure data governance , security , and compliance standards are maintained. Required Qualifications 7–12 years of experience in big data engineering or backend data systems. Strong hands-on programming skills in Java ; exposure to Scala or Python is a plus. Proven experience with Apache Spark , Hadoop (HDFS, YARN, MapReduce), and related tools. Solid understanding of distributed computing , data partitioning, and optimization techniques. Experience with data access and storage layers like Hive , HBase , or Impala . Familiarity with data ingestion tools like Apache Kafka , NiFi , Flume , or Sqoop . Comfortable working with SQL for querying large datasets. Good understanding of data architecture , data modeling , and data lifecycle management . Experience with cloud platforms like AWS , Azure , or Google Cloud Platform . Strong problem-solving, analytical, and communication skills. Preferred Qualifications Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field. Experience with streaming data frameworks such as Spark Streaming , Kafka Streams , or Flink . Knowledge of DevOps practices , CI/CD pipelines, and infrastructure as code (e.g., Terraform). Exposure to containerization (Docker)and orchestration (Kubernetes) . Certifications in Big Data technologies or Cloud platforms are a plus. Please note that this is an equal opportunities employer. #J-18808-Ljbffr

  • Data Engineer

    1 day ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$5,000 - S$9,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake yarn Oracle Shell Script CI Shell UNIX Presto Java MSSQL Airflow Spark Linux Python Astek is proposing an opportunity for **Data Engineer** (Big Data) to support our project based in**...

  • Data Engineer

    1 day ago

    Singapore TALENTSIS PTE. LTD. Full time

    We are looking for a skilled **Data Engineer**with a focus on **Big Data**to design, develop, and manage large-scale data processing systems. If you're passionate about working with big data technologies and driving impactful solutions, we want to hear from you. **Key Responsibilities**: - Build and maintain big data pipelines using technologies like...

  • Big Data Engineer

    2 weeks ago

    Singapore Unison Group Full time $120,000 - $180,000 per year

    We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...

  • Big Data Engineer

    4 days ago

    Singapore UNISON Group Full time $80,000 - $120,000 per year

    We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...

  • Big Data Platform Engineer

    3 days ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    **SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...

  • Platform Engineer – Big Data

    2 days ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time $104,000 - $130,878 per year

    We are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN)...

  • Principal Big Data Engineer

    1 day ago

    Singapore LUMINARY SERVICE PTE. LTD. Full time

    Design and implement scalable data pipelines to collect, process, and store large volumes of structured and unstructured data. Ensure data quality, integrity, and consistency across various data sources. Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business...

  • Big Data Architect

    6 days ago

    Singapore Direct Search Global Full time

    **Job Detail**: - Job Reference - P5549 **Role**: Installing and maintaining operating environments Support in the Big Data stack area of responsibility Align the work of ongoing projects with the organization’s big data solution. Educating and supporting additional O&M team members and partners Accountable for the production environment’s Big Data...

  • Platform Engineer – Big Data

    2 days ago

    Singapore UARROW PTE. LTD. Full time $120,000 - $180,000 per year

    Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.Build and support Hive-based data warehouses for...

  • Big Data Engineer

    6 days ago

    Singapore Capgemini Full time

    Capgemini SingaporePosted 3 hours ago Hybrid Permanent S$70k - S$90k - Posted by - Nirzham Shah- Talent Acquisition ManagerFollow - A Big Data Engineer is an information technology (IT) professional who is responsible for designing, building, testing and maintaining complex data processing systems that work with large data sets. **Job responsibilities**: -...