
Platform Engineer – Big Data
4 weeks ago
We are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;
Responsibilities
- Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive.
- Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.
- Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.
- Build and support Hive-based data warehouses for analytics, including schema design, partitioning, and performance optimization.
- Optimize Spark jobs for batch and streaming use cases (memory management, shuffle tuning, query optimization).
- Implement data security and governance policies (Kerberos, Ranger, Atlas) to ensure compliance and controlled access.
- Collaborate with data engineers, architects, and analysts to deliver robust and efficient platform capabilities.
- Drive automation in cluster operations, deployments, and monitoring using scripting and DevOps tools.
Skills
- Experience in data engineering or platform engineering with strong focus on big data ecosystems.
- Deep expertise in Hadoop (HDFS, YARN) cluster management and optimization.
- Strong hands-on experience in Spark (batch + streaming) and Hive data modeling.
- Experience in performance tuning, query optimization, and cluster troubleshooting.
- Familiarity with distributed system internals, resource management, and fault tolerance.
- Knowledge of cloud big data platforms (AWS EMR, Azure HDInsight, GCP Dataproc) is a plus.
- Exposure to automation frameworks (Ansible, Terraform, Airflow, CI/CD pipelines) is preferred.
Airflow
Tolerance
Azure
Big Data
Data Modeling
Pipelines
Hadoop
Architects
Scripting
Tuning
Data Engineering
EMR
Performance Tuning
GCP
Resource Management
Ansible
-
Big Data Platform Engineer
2 weeks ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time**SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...
-
Platform Engineer – Big Data
5 days ago
Singapore RISKDATA CONSULTING PTE. LTD. Full time $104,000 - $130,878 per yearWe are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN)...
-
Platform Engineer – Big Data
4 weeks ago
Singapore UNISON CONSULTING PTE. LTD. Full timeRoles & Responsibilities•Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive.•Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.•Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.•Build and...
-
Platform Engineer – Big Data
5 days ago
Singapore UARROW PTE. LTD. Full time $120,000 - $180,000 per yearDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.Build and support Hive-based data warehouses for...
-
Big Data Platform Engineer
4 weeks ago
Singapore COGNIZANT TECHNOLOGY SOLUTIONS ASIA PACIFIC PTE. LTD. Full timeRoles & ResponsibilitiesRole & ResponsibilitiesOperating Global Data Platform components (VM Servers, Kubernetes, Kafka) and applications (Apache stack, Collibra, Dataiku and similar). Implement automation of infrastructure, security components, and Continuous Integration & Continuous Delivery for optimal execution of data pipelines (ELT/ETL). Develop...
-
Big Data Platform Engineer
2 weeks ago
Singapore Cognizant Technology Solutions Full time $100,000 - $150,000 per yearThe must have skills sets :DevOps tools like Jenkins, GitLab CI/CD, or similarContainerization using Docker and KubernetesReal-time data integration using Apache KafkaDistributed SQL engines like Presto and TrinoCloud-based object storage solutions like Amazon S3Experience with cloud migration, including assessment, planning, execution, and...
-
Senior Big Data Platform SRE Engineer
3 days ago
Singapore Tencent Full timeTechnology Engineering Group (TEG) is responsible for supporting the company and its business groups on technology and operational platforms, as well as the construction and operation of R&D management and data centers, TEG provides users with a full range of customer services. As the operator of the largest networking, devices, and data center in Asia, TEG...
-
Big Data Engineer
5 days ago
Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full timeJob Title: Big Data Engineer (Java, Spark, Hadoop)Location : Singapore Experience : 7- 12 years Employment Type : Full-Time Open to Citizens and SPR only | No Visa sponsorship available Job Summary We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep...
-
Big Data Engineer
2 weeks ago
Singapore SAKSOFT PTE LIMITED Full timeExperience: 9+ Years Role: Big Data Engineer Skills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting(Good to have). Design...
-
Big Data Engineer
1 day ago
Singapore ALMR CONSULTING PTE. LTD. Full time $100,000 - $150,000 per yearJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.Key...