Big Data Cluster Operations Specialist

1 month ago


Singapore Tencent Singapore Full time
About Tencent Singapore

Tencent Singapore is an Internet-based platform company founded in Singapore, with a mission to "Value for Users, Tech for Good". We embrace a culture of teamwork & creativity and are driven by our values - Integrity, Proactivity, Collaboration and Creativity.

We are rapidly expanding our international operations and are looking for top talent to propel us forward. Combining the results-oriented nature of a startup with the resources of a profitable and leading Internet company, Tencent offers a unique opportunity for aspiring individuals to thrive.

About the Role

Since the first Hadoop cluster was built in 2009, Tencent Data Platform Department has continuously explored and practiced with the mission of "data-driven, maximizing business value". At present, the platform's computing power elastic resource pool has exceeded 200,000 units, and every day The number of data access pieces reaches 35 trillion pieces, forming a set of data service-oriented platforms around the full life cycle of data; at the same time, it provides mass, real-time, and accurate personalized recommendation services driven by full-process data for the company's advertising business, providing Tencent Each business outputs professional data foundation and application solutions.
  • Responsible for the operation and maintenance of big data cluster (Hadoop Hbase Hive Yarn Spark, etc.);
  • Responsible for cluster performance optimization, expansion and contraction;
  • Responsible for cluster monitoring and alarm, fault handling, data backup, user problem handling, etc.

Requirements
  • Bachelor's degree in Computer Science or a related field
  • Ideally with experience in big data cluster operation and maintenance;
  • Proficient in any language in Python Shell Java, familiar with Linux development environment and corresponding configuration, management and optimization;
  • Familiar with TCP/IP, HTTP and other protocols, and have good knowledge of network, security, database, computer architecture.
  • Fluent in Chinese and English is preferred in order to communicate with various stakeholders in headquarters


  • Singapore WECHAT INTERNATIONAL PTE. LTD. Full time

    WeChat International PTE. LTD. is seeking a highly skilled and experienced expert to join our team as a Tencent Big Data Cluster Operations Expert.The ideal candidate will have a strong background in big data cluster operation and maintenance, with experience in managing large-scale Hadoop clusters, Kubernetes, and other related...


  • Singapore WECHAT INTERNATIONAL PTE. LTD. Full time

    About WeChat International PTE. LTD.We are a leading Internet-based platform company founded in Shenzhen, China, in 1998. Our mission is to provide value for users and technology for good. We foster a culture of teamwork & creativity, driven by our values - Integrity, Proactivity, Collaboration, and Creativity.With rapidly expanding international operations,...


  • Singapore NTT DATA Services Full time

    About NTT DATANTT DATA is a trusted global innovator of business and technology services.We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. Job OverviewThe Software Development Senior Analyst role requires strong data engineering concepts and programming experience. This...


  • Singapore Unison Consulting Pte Ltd Full time

    Job OverviewWe are seeking a skilled and experienced Hadoop Administrator to join our team at Unison Consulting Pte Ltd. This role is responsible for designing, implementing, and maintaining our Hadoop infrastructure to ensure the smooth functioning of our big data ecosystem.Key ResponsibilitiesHadoop Cluster Management: Install, configure, and maintain...


  • Singapore ZENITH INFOTECH (S) PTE LTD. Full time

    At Zenith Infotech (S) Pte Ltd, we are seeking an experienced Big Data Migration Specialist to join our team. The ideal candidate will have a strong background in data engineering and migration, with expertise in AWS services, Databricks, and Informatica IDMC.About the RoleThis is a key role within our organization, responsible for migrating data from...


  • Singapore ADVANCED E-SOLUTIONS PTE. LTD. Full time

    We are seeking a highly skilled Big Data Support Specialist to join our team at ADVANCED E-SOLUTIONS PTE. LTD. This role offers an exciting opportunity to work on complex data pipelines and support big data systems in a fast-paced banking/financial services industry environment.The estimated salary for this position is SGD $80,000 - SGD $110,000 per annum,...

  • Big data engineer

    2 days ago


    Singapore SAKSOFT PTE LIMITED Full time

    Roles & ResponsibilitiesExperience: 9+ YearsRole: Big Data EngineerSkills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is MustDatabase knowledge and should be able to write the queries is Must.Handson on Unix Shell scripting is Must.Knowledge in Spark SQL (Good to have).Understand on Regulatory reporting(Good to...

  • Big data engineer

    2 weeks ago


    Singapore SAKSOFT PTE LIMITED Full time

    Roles & ResponsibilitiesExperience: 9+ YearsRole: Big Data EngineerSkills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is MustDatabase knowledge and should be able to write the queries is Must.Handson on Unix Shell scripting is Must.Knowledge in Spark SQL (Good to have).Understand on Regulatory reporting(Good to...


  • Singapore Unison Consulting Pte Ltd Full time

    About UsUnison Consulting Pte Ltd is a leading consulting firm that specializes in data engineering solutions.We are seeking a highly skilled Big Data Engineering Specialist to join our team.Job DescriptionJob Title: Big Data Engineering SpecialistEstimated Salary: $120,000 - $180,000 per annumAs a Big Data Engineering Specialist at Unison Consulting Pte...


  • Singapore TikTok Full time

    About the TeamWe are the global engineering team for Tea, a cutting-edge in-house analytics platform that is heavily used by over 10,000 employees worldwide. Our mission is to build the best data analytics platform in the world.Job SummaryWe are seeking an experienced Data Analytics Platform Engineer - Big Data Specialist to join our talented team. The ideal...


  • Singapore Centre for Strategic Infocomm Technologies Full time

    Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from...

  • Data Scientist

    2 weeks ago


    Singapore MICRON SEMICONDUCTOR ASIA OPERATIONS PTE. LTD. Full time

    Job OverviewWe are seeking a highly skilled Data Scientist to join our team at Micron Semiconductor Asia Operations PTE. LTD. As a Data Scientist, you will be responsible for designing, developing, and programming methods, processes, and systems to consolidate and analyze unstructured, diverse big data sources.About the RoleThis is a unique opportunity to...


  • Singapore KERRY CONSULTING GROUP PTE. LTD. Full time

    About Kerry Consulting Group PTE. LTD.We are Kerry Consulting Group PTE. LTD., a leading consulting firm in the field of data analytics and cloud computing.Job OverviewWe are seeking an experienced Big Data Analytics Specialist to join our team. This role will involve designing, developing, and implementing big data solutions using Cloudera Distributed...


  • Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full time

    We are Softenger (Singapore) PTE. LTD., a cutting-edge technology company, and we are seeking a highly skilled Senior Big Data Engineering Specialist to join our team.About the RoleThis is a contract position lasting 1 year, with a possibility of renewal. As a Senior Big Data Engineering Specialist, you will play a crucial role in building and optimizing big...


  • Singapore D L RESOURCES PTE LTD Full time

    About the RoleWe are seeking a highly skilled Big Data Engineering and Architecture Specialist to join our team at D L RESOURCES PTE LTD. As a key member of our data engineering group, you will be responsible for designing and implementing scalable, efficient, and secure big data solutions.


  • Singapore D L RESOURCES PTE LTD Full time

    About the RoleWe are seeking a skilled Big Data Architectural Specialist to join our team at D L RESOURCES PTE LTD. As a key member of our technology group, you will play a crucial role in designing and implementing end-to-end software solutions for our projects.

  • Big Data Architect

    2 weeks ago


    Singapore KRIS INFOTECH PTE. LTD. Full time

    About KRIS INFOTECH PTE. LTD.Located in a prime location, we offer a competitive salary and excellent benefits to our employees. Our company is committed to providing innovative solutions to our clients.Job Description:We are seeking a highly skilled Data Migration Specialist to join our team. The successful candidate will be responsible for migrating from...


  • Singapore MICRON SEMICONDUCTOR ASIA OPERATIONS PTE. LTD. Full time

    We are seeking a highly skilled Senior Data Scientist to join our team at Micron Semiconductor Asia Operations PTE. LTD.About the RoleAs a Senior Data Scientist, you will be responsible for designing, developing, and programming methods, processes, and systems to consolidate and analyze unstructured, diverse "big data" sources to generate actionable insights...


  • Singapore Helius Full time

    Job DescriptionAbout the RoleWe are seeking a highly skilled Big Data Integration Specialist to join our team at Helius. As a key member of our data integration team, you will be responsible for designing and implementing production-grade Talend Big Data jobs that meet our IT organization's architecture standards.Key ResponsibilitiesDevelop and maintain...

  • Software Consultant

    2 days ago


    Singapore RECRUIT EXPRESS PTE LTD Full time

    Roles & ResponsibilitiesResponsibilities Defines, develops or modifies application modules or enterprise-wide software systems using disciplined software development processes and makes modules production ready by moving them to libraries, completing forms, following procedures, completing version control documents Develop Hadoop and Web-Service based...