
Senior Big Data Engineer
4 days ago
We're seeking an experienced Big Data Platform Architect to design, build and manage scalable big data platforms.
The ideal candidate will have in-depth knowledge of Hadoop, Spark and Hive, as well as strong experience in data engineering and platform architecture.
- Design and implement high-performance big data pipelines using Hadoop, Spark and Hive.
- Develop and optimize data ingestion, transformation and storage frameworks for high-volume datasets.
- Maintain and fine-tune Hadoop clusters for optimal performance, including capacity planning, monitoring and troubleshooting.
- Create and support Hive-based data warehouses for analytics, including schema design, partitioning and performance optimization.
- Optimize Spark jobs for batch and streaming use cases, focusing on memory management, shuffle tuning and query optimization.
- Implement data security and governance policies to ensure compliance and controlled access.
- Collaborate with data engineers, architects and analysts to deliver robust and efficient platform capabilities.
- Drive automation in cluster operations, deployments and monitoring using scripting and DevOps tools.
- Deep expertise in Hadoop cluster management and optimization.
- Strong hands-on experience in Spark (batch + streaming) and Hive data modeling.
- Experience in performance tuning, query optimization and cluster troubleshooting.
- Familiarity with distributed system internals, resource management and fault tolerance.
- Knowledge of cloud big data platforms is a plus.
- Exposure to automation frameworks is preferred.
-
Big Data Engineer
7 days ago
Singapore beBeeDataEngineering Full time $80,000 - $120,000Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing complex data pipelines using Apache Spark.Main Responsibilities:Design and optimize data pipelines using Apache SparkDevelop and maintain Hive tables, queries, and...
-
Senior Engineer
3 days ago
Singapore Reeracoen Singapore Pte Ltd Full timeOur client is a dynamic technology consulting company specializing in digital transformation and innovative solutions. They are currently looking for a Senior Engineer (Big Data) to join their tech engineering team. - 【 What you will be doing 】- Responsible for designing, creating, and managing large-scale data processing systems. - Ensure that systems...
-
Big Data Engineer
2 weeks ago
Singapore Baidu, Inc. Full timeDirect message the job poster from Baidu, Inc. Responsibilities Build the company's big data warehouse system, including batch and stream data flow construction; In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance Responsible...
-
Senior Big Data Engineer
5 days ago
Singapore Proofpoint Full timeIt's fun to work in a company where people truly BELIEVE in what they're doing! - We're committed to bringing passion and customer focus to the business._ - Senior Big Data Engineer Excited to grow your career? - We value our talented employees, and whenever possible strive to help one of our associates grow professionally before recruiting new talent to...
-
Big Data Engineer
6 days ago
Singapore Unison Consulting Full timeGet AI-powered advice on this job and more exclusive features. We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing,...
-
Senior Site Reliability Engineer
4 hours ago
Singapore NodeFlair Full time**Job Summary**: **Salary** S$8,000 - S$13,000 / Monthly **Job Type** **Seniority** Senior **Years of Experience** At least 5 years **Tech Stacks** HBase Spark Linux kafka Flink Hadoop **Job** **Description**: - Design and develop software solutions to automate the technical operations of large-scale systems - Work closely with cross-functional teams...
-
Senior Big Data Platform Engineer
2 weeks ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full timeData processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...
-
Senior Big Data Architect
4 days ago
Singapore beBeeDataEngineer Full time $120,000 - $180,000Big Data EngineerWe are seeking a highly motivated and skilled Big Data Engineer to join our dynamic team.Responsibilities:Data Engineering: Design, develop, and maintain complex big data systems for efficient data processing.Data Management: Implement and manage large-scale data storage solutions using relational databases and NoSQL technologies.Apache...
-
Big Data Platform Engineer
2 days ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full timeJoin to apply for the Big Data Platform Engineer role at Centre for Strategic Infocomm Technologies (CSIT) 1 week ago Be among the first 25 applicants Join to apply for the Big Data Platform Engineer role at Centre for Strategic Infocomm Technologies (CSIT) Data processing is an essential part of national security in the modern world. As an engineer in...
-
Big Data Systems Engineer
2 weeks ago
Singapore beBeeData Full time $180,000 - $240,000Job DescriptionData processing plays a vital role in national security in today's world.Develop and maintain real-time high-volume data processing, querying, and persistence solutions using Big Data technologies.Implement highly available, resilient, scalable, and sustainable Big Data platforms.Administer Big Data platform services running across multiple...