Big Data Platform Engineer
3 days ago
**The must have skills sets**:
- DevOps tools like Jenkins, GitLab CI/CD, or similar
- Containerization using Docker and Kubernetes
- Real-time data integration using Apache Kafka
- Distributed SQL engines like Presto and Trino
- Cloud-based object storage solutions like Amazon S3
- Experience with cloud migration, including assessment, planning, execution, and validation
- Experience with disaster recovery setup, including backup and restore processes, replication, and failover mechanisms
- Experience with Python
**Good to have -**
- Apache Spark and big data processing
- Data science platforms like Dataiku
- Ansible Playbooks to automate infrastructure provisioning, configuration, and deployment.
- Terraform to manage and provision cloud infrastructure resources
LI-CTSAPAC
-
Big Data Engineer, Data Platform
3 days ago
Singapore NodeFlair Full time**Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** ETL ClickHouse Metastore Analytics R Flume Presto Hive Spark kafka Flink SQL **Responsibilities** TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require...
-
Big Data Engineer, Web3 Data Platform
1 week ago
Singapore P2P Full timeOKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa About OKX At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto...
-
Big Data Engineer, Web3 Data Platform
1 week ago
Singapore Crypto Pro Network Full timeOKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa About OKX At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto...
-
Senior Big Data Platform SRE Engineer
2 weeks ago
Singapore Tencent Full timeTechnology Engineering Group (TEG) is responsible for supporting the company and its business groups on technology and operational platforms, as well as the construction and operation of R&D management and data centers, TEG provides users with a full range of customer services. As the operator of the largest networking, devices, and data center in Asia, TEG...
-
Platform Engineer
5 days ago
Singapore RISKDATA CONSULTING PTE. LTD. Full timeWe are hiring Platform Engineer - Big Data (Hadoop / Spark / Hive) with below requirements; **Responsibilities** - Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive. - Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets. - Maintain and fine-tune Hadoop clusters...
-
Big Data Global Manager
3 days ago
Singapore TikTok Full timeResponsibilities About TikTok TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo. Why Join Us Creation is the core of TikTok's purpose. Our platform is built to help...
-
Big Data Engineer
1 week ago
Singapore ALMR CONSULTING PTE. LTD. Full time**Job Summary**: We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs. **Key...
-
Big Data Platform Architect
2 weeks ago
Singapore BigTapp Full time**Job Title**: Big Data Platform Architect **Job Location**: Singapore **Job Purpose** The Big Data Platform Architect is responsible for the technical design and implementation of big data platform, systems integration, processes and governance to operationalize the big data platform. The Big Data Platform Architect is required to work closely with...
-
Big Data Engineer, Web3 Data Platform
2 days ago
Singapore OKX Full timeOKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visaAbout OKX At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto...
-
Big Data Engineer
1 week ago
Singapore ALMR Consulting Pte Ltd Full time**Roles & Responsibilities** **Job Summary**: We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and...