
Data Engineering Technologist – Large-Scale Distributed Systems
3 days ago
We are hiring Data Engineering Technologist – Large-Scale Distributed Systems with below requirements;
Responsibilities
- Design and maintain ETL/ELT pipelines using Spark for batch and streaming data.
- Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability.
- Build and maintain Hive data models, partitions, and queries for analytics and reporting.
- Improve query and pipeline performance through tuning, partitioning, bucketing, and caching.
- Ensure data quality, governance, and security across the big data ecosystem.
- Collaborate with data scientists, analysts, and architects to support advanced analytics and BI.
Skills
- Experience in data engineering or big data development.
- Strong hands-on experience in Spark (Core, SQL, Streaming).
- Good understanding of Hadoop (HDFS, YARN) architecture.
- Expertise in Hive data modeling, query optimization, and performance tuning.
- Experience with cluster troubleshooting, monitoring, and scaling.
- Knowledge of data governance and security frameworks is a plus.
- Familiarity with cloud big data platforms (AWS EMR, Azure HDInsight, or GCP Dataproc) preferred.
Scalability
Azure
Big Data
Data Modeling
Pipelines
Hadoop
Architects
Data Quality
Data Governance
Reliability
Tuning
Data Engineering
EMR
Distributed Systems
Performance Tuning
GCP
-
Data Engineering Technologist
3 days ago
Singapore RISKDATA CONSULTING PTE. LTD. Full timeWe are hiring Data Engineering Technologist - Large-Scale Distributed Systems with below requirements; **Responsibilities** - Design and maintain ETL/ELT pipelines using Spark for batch and streaming data. - Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability. - Build and maintain Hive data models, partitions, and queries for...
-
Singapore RISKDATA CONSULTING PTE. LTD. Full time $104,000 - $130,878 per yearWe are hiring Data Engineering Technologist – Large-Scale Distributed Systems with below requirements;ResponsibilitiesDesign and maintain ETL/ELT pipelines using Spark for batch and streaming data.Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability.Build and maintain Hive data models, partitions, and queries for analytics and...
-
Large Scale Distributed Systems Engineer
3 days ago
Singapore beBeeReliability Full time $125,000 - $175,000Job TitleA senior site reliability engineer is needed to ensure the smooth operation of large-scale distributed systems.Design, deploy, and manage CI/CD pipelines to deliver software consistently.Administer, scale, and optimize Kubernetes deployments for high availability and fault tolerance.Architect and maintain microservices infrastructure for seamless...
-
Large Scale Data Engineering Professional
3 days ago
Singapore beBeeDataEngineering Full time $120,000 - $180,000Large Scale Data Engineering ExpertWe are seeking an experienced Large Scale Data Engineering Expert to join our team. As a key member of our team, you will play a vital role in designing and maintaining large-scale distributed systems.The ideal candidate will have hands-on experience with Spark (Core, SQL, Streaming), a good understanding of Hadoop (HDFS,...
-
Large Scale Data Engineering Professional
20 hours ago
Singapore beBeeDataEngineering Full timeLarge Scale Data Engineering Expert We are seeking an experienced Large Scale Data Engineering Expert to join our team. As a key member of our team, you will play a vital role in designing and maintaining large-scale distributed systems. The ideal candidate will have hands-on experience with Spark (Core, SQL, Streaming), a good understanding of Hadoop...
-
Singapore beBeeDataEngineer Full time $180,000 - $240,000As a seasoned data engineering professional, you will play a key role in the design and implementation of large-scale distributed systems.Job DescriptionThe ideal candidate will possess a strong background in data engineering or big data development, with hands-on experience in Spark (Core, SQL, Streaming). They should also have a solid understanding of...
-
Large Scale Distributed Data Systems Specialist
19 hours ago
Singapore beBeeDataEngineer Full timeAs a seasoned data engineering professional, you will play a key role in the design and implementation of large-scale distributed systems. Job Description The ideal candidate will possess a strong background in data engineering or big data development, with hands-on experience in Spark (Core, SQL, Streaming). They should also have a solid understanding...
-
Large Scale Data Architect
1 day ago
Singapore beBeeData Full time $120,000 - $180,000We are seeking a skilled Big Data Engineer to join our E-commerce Recommendation Infrastructure team.Job DescriptionThis role involves designing and implementing large-scale recommendation systems, ensuring high-performance storage and computing systems, and troubleshooting production issues. You will work closely with applied machine learning engineers to...
-
Data Engineering Technologist
1 day ago
Singapore RISKDATA CONSULTING PTE. LTD. Full timeRoles & Responsibilities We are hiring Data Engineering Technologist – Large-Scale Distributed Systems with below requirements; Responsibilities Design and maintain ETL/ELT pipelines using Spark for batch and streaming data. Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability. Build and maintain Hive data models,...
-
Data Engineer
3 days ago
Singapore beBeeDataEngineer Full time $80,000 - $120,000Job DescriptionOur team is responsible for designing and implementing large-scale recommendation systems. We focus on optimizing the architecture to provide a stable and high-quality experience for users.We are looking for talented individuals to join our team. As a graduate, you will have opportunities to pursue bold ideas, tackle complex challenges, and...