Big Data Platform Engineer
2 days ago
**The must have skills sets**:
- DevOps tools like Jenkins, GitLab CI/CD, or similar
- Containerization using Docker and Kubernetes
- Real-time data integration using Apache Kafka
- Distributed SQL engines like Presto and Trino
- Cloud-based object storage solutions like Amazon S3
- Experience with cloud migration, including assessment, planning, execution, and validation
- Experience with disaster recovery setup, including backup and restore processes, replication, and failover mechanisms
- Experience with Python
**Good to have -**
- Apache Spark and big data processing
- Data science platforms like Dataiku
- Ansible Playbooks to automate infrastructure provisioning, configuration, and deployment.
- Terraform to manage and provision cloud infrastructure resources
LI-CTSAPAC
-
Big Data Platform Engineer
2 weeks ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full timeData processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...
-
Senior Big Data Platform Engineer
2 weeks ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full timeData processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...
-
Big Data Engineer, Data Platform
2 days ago
Singapore NodeFlair Full time**Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** ETL ClickHouse Metastore Analytics R Flume Presto Hive Spark kafka Flink SQL **Responsibilities** TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require...
-
Big Data Platform SRE Engineer
2 days ago
Singapore Tencent Full timeBusiness Unit Technology Engineering Group (TEG) is responsible for supporting the company and its business groups on technology and operational platforms, as well as the construction and operation of R&D management and data centers. TEG provides users with a full range of customer services and, as the operator of the largest networking, device, and data...
-
Big Data Engineer, Web3 Data Platform
1 week ago
Singapore OKX Full timeOKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa About OKX At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto...
-
Senior Big Data Platform SRE Engineer
4 days ago
Singapore Tencent Full timeTechnology Engineering Group (TEG) is responsible for supporting the company and its business groups on technology and operational platforms, as well as the construction and operation of R&D management and data centers, TEG provides users with a full range of customer services. As the operator of the largest networking, devices, and data center in Asia, TEG...
-
Big Data Global Manager
2 days ago
Singapore TikTok Full timeResponsibilities About TikTok TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo. Why Join Us Creation is the core of TikTok's purpose. Our platform is built to help...
-
Big Data Platform Architect
2 weeks ago
Singapore BigTapp Full time**Job Title**: Big Data Platform Architect **Job Location**: Singapore **Job Purpose** The Big Data Platform Architect is responsible for the technical design and implementation of big data platform, systems integration, processes and governance to operationalize the big data platform. The Big Data Platform Architect is required to work closely with...
-
Big Data Engineer
2 weeks ago
Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full timeJob Title: Big Data Engineer (Java, Spark, Hadoop)Location : Singapore Experience : 7- 12 years Employment Type : Full-Time Open to Citizens and SPR only | No Visa sponsorship available Job Summary We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep...
-
Big Data Development Engineer
3 days ago
Singapore NodeFlair Full time**Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 1 year **Tech Stacks** ClickHouse Analytics Java Spark Scala Hadoop **Responsibilities** **About TikTok** TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok...