Data Engineering Technologist – Large-Scale Distributed Systems
4 days ago
We are hiring Data Engineering Technologist – Large-Scale Distributed Systems with below requirements;
Responsibilities
- Design and maintain ETL/ELT pipelines using Spark for batch and streaming data.
- Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability.
- Build and maintain Hive data models, partitions, and queries for analytics and reporting.
- Improve query and pipeline performance through tuning, partitioning, bucketing, and caching.
- Ensure data quality, governance, and security across the big data ecosystem.
- Collaborate with data scientists, analysts, and architects to support advanced analytics and BI.
Skills
- Experience in data engineering or big data development.
- Strong hands-on experience in Spark (Core, SQL, Streaming).
- Good understanding of Hadoop (HDFS, YARN) architecture.
- Expertise in Hive data modeling, query optimization, and performance tuning.
- Experience with cluster troubleshooting, monitoring, and scaling.
- Knowledge of data governance and security frameworks is a plus.
- Familiarity with cloud big data platforms (AWS EMR, Azure HDInsight, or GCP Dataproc) preferred.
-
Data Engineering Technologist
5 days ago
Singapore RISKDATA CONSULTING PTE. LTD. Full timeWe are hiring Data Engineering Technologist - Large-Scale Distributed Systems with below requirements; **Responsibilities** - Design and maintain ETL/ELT pipelines using Spark for batch and streaming data. - Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability. - Build and maintain Hive data models, partitions, and queries for...
-
Singapore RISKDATA CONSULTING PTE. LTD. Full timeRoles & ResponsibilitiesWe are hiring Data Engineering Technologist – Large-Scale Distributed Systems with below requirements;ResponsibilitiesDesign and maintain ETL/ELT pipelines using Spark for batch and streaming data. Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability. Build and maintain Hive data models, partitions, and...
-
Large Scale Distributed Systems Engineer
4 days ago
Singapore beBeeReliability Full time $125,000 - $175,000Job TitleA senior site reliability engineer is needed to ensure the smooth operation of large-scale distributed systems.Design, deploy, and manage CI/CD pipelines to deliver software consistently.Administer, scale, and optimize Kubernetes deployments for high availability and fault tolerance.Architect and maintain microservices infrastructure for seamless...
-
Large Scale Data Engineering Professional
3 days ago
Singapore beBeeDataEngineering Full timeLarge Scale Data Engineering Expert We are seeking an experienced Large Scale Data Engineering Expert to join our team. As a key member of our team, you will play a vital role in designing and maintaining large-scale distributed systems. The ideal candidate will have hands-on experience with Spark (Core, SQL, Streaming), a good understanding of Hadoop...
-
Large Scale Data Engineering Professional
5 days ago
Singapore beBeeDataEngineering Full time $120,000 - $180,000Large Scale Data Engineering ExpertWe are seeking an experienced Large Scale Data Engineering Expert to join our team. As a key member of our team, you will play a vital role in designing and maintaining large-scale distributed systems.The ideal candidate will have hands-on experience with Spark (Core, SQL, Streaming), a good understanding of Hadoop (HDFS,...
-
Singapore beBeeDataEngineer Full time $180,000 - $240,000As a seasoned data engineering professional, you will play a key role in the design and implementation of large-scale distributed systems.Job DescriptionThe ideal candidate will possess a strong background in data engineering or big data development, with hands-on experience in Spark (Core, SQL, Streaming). They should also have a solid understanding of...
-
Singapore beBeeDataEngineer Full timeAs a seasoned data engineering professional, you will play a key role in the design and implementation of large-scale distributed systems. Job Description The ideal candidate will possess a strong background in data engineering or big data development, with hands-on experience in Spark (Core, SQL, Streaming). They should also have a solid understanding...
-
Large Scale Data Architect
3 days ago
Singapore beBeeData Full time $120,000 - $180,000We are seeking a skilled Big Data Engineer to join our E-commerce Recommendation Infrastructure team.Job DescriptionThis role involves designing and implementing large-scale recommendation systems, ensuring high-performance storage and computing systems, and troubleshooting production issues. You will work closely with applied machine learning engineers to...
-
Data Engineering Technologist
3 days ago
Singapore RISKDATA CONSULTING PTE. LTD. Full timeRoles & Responsibilities We are hiring Data Engineering Technologist – Large-Scale Distributed Systems with below requirements; Responsibilities Design and maintain ETL/ELT pipelines using Spark for batch and streaming data. Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability. Build and maintain Hive data models,...
-
Data Engineer
4 days ago
Singapore beBeeDataEngineer Full time $80,000 - $120,000Job DescriptionOur team is responsible for designing and implementing large-scale recommendation systems. We focus on optimizing the architecture to provide a stable and high-quality experience for users.We are looking for talented individuals to join our team. As a graduate, you will have opportunities to pursue bold ideas, tackle complex challenges, and...