Senior Big Data Platform SRE Engineer

3 days ago

Singapore Tencent Full time

Technology Engineering Group (TEG) is responsible for supporting the company and its business groups on technology and operational platforms, as well as the construction and operation of R&D management and data centers, TEG provides users with a full range of customer services. As the operator of the largest networking, devices, and data center in Asia, TEG also leads the Tencent Technology Committee in strengthening infrastructure R&D through internal and distributed open source collaboration, constructing new platforms and supporting business innovation. What The Role Entails Oversee the operation and maintenance of Tencent\'s overseas big data platforms to ensure platform and cluster stability. Assist users in resolving issues related to big data platform usage, including but not limited to platform operations, component errors, and performance optimisation. Optimise existing service workflows, standards, and pain points, and propose actionable solutions. Develop front-end/back-end operational efficiency tools, including but not limited to: capacity management platforms, DevOps frameworks, coverage analytics, automation systems, and health monitoring. Optimise big data cluster costs by implementing new technologies or architectures to improve processing efficiency and reduce operational expenses. Who We Look For Proficient in ≥2 of these big data technologies: HDFS, YARN, Flink, Spark, Presto, Hive, HBase, StarRocks. Skilled in ≥1 programming language (Java/Python/Golang, etc.). Expertise in Linux/Unix OS, system performance tuning, and failure resolution. ≥3 years of big data operation/development experience, with strong troubleshooting skills, technical sensitivity, and risk identification capabilities. Knowledge of mainstream big data platforms (e.g., Databricks, Snowflake) will be considered a strong plus. Equal Employment Opportunity at Tencent As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals. Seniority level Mid-Senior level Employment type Full-time Job function Information Technology Industries Software Development Referrals increase your chances of interviewing at Tencent by 2x #J-18808-Ljbffr

  • Big Data Sre Operations Expert

    1 week ago

    Singapore ByteDance Full time

    **Location**: Singapore **Team**: Technology **Employment Type**: Regular **Job Code**: A117803A **Responsibilities**: About the team ByteDance and affiliate are developing the next-generation high-performance analytical database, with a mission to enable efficient and real-time data-driven decision-making on PB-level data sets. The initial product was...

  • Big Data Platform Engineer

    2 weeks ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    **SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...

  • Platform Engineer – Big Data

    4 weeks ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesWe are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive. Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets. Maintain and fine-tune...

  • Platform Engineer – Big Data

    6 days ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time $104,000 - $130,878 per year

    We are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN)...

  • Platform & SRE Engineer (Database and Search Platform)

    1 week ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Overview Platform & SRE Engineer (Database and Search Platform) at CSIT. CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of operations, including but not limited to Counter-terrorism and Computer Network Defence. Join the CSIT family and use cutting-edge technologies to protect the nation....

  • Platform Engineer – Big Data

    4 weeks ago

    Singapore UNISON CONSULTING PTE. LTD. Full time

    Roles & Responsibilities•Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive.•Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.•Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.•Build and...

  • Platform Engineer – Big Data

    6 days ago

    Singapore UARROW PTE. LTD. Full time $120,000 - $180,000 per year

    Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.Build and support Hive-based data warehouses for...

  • Big Data Platform Engineer

    4 weeks ago

    Singapore COGNIZANT TECHNOLOGY SOLUTIONS ASIA PACIFIC PTE. LTD. Full time

    Roles & ResponsibilitiesRole & ResponsibilitiesOperating Global Data Platform components (VM Servers, Kubernetes, Kafka) and applications (Apache stack, Collibra, Dataiku and similar). Implement automation of infrastructure, security components, and Continuous Integration & Continuous Delivery for optimal execution of data pipelines (ELT/ETL). Develop...

  • Big Data SRE Operations Expert

    1 week ago

    Singapore ByteDance Full time $120,000 - $200,000 per year

    Location:SingaporeTeam:TechnologyEmployment Type:RegularJob Code:A117803AResponsibilitiesAbout the teamByteDance and affiliate are developing the next-generation high-performance analytical database, with a mission to enable efficient and real-time data-driven decision-making on PB-level data sets. The initial product was forked from Clickhouse, after which...

  • Senior Site Reliability Engineer, Data Platform

    2 weeks ago

    Singapore Shopify Full time

    Company Description Shopify is the leading omni-channel commerce platform. Merchants use Shopify to design, set up, and manage their stores across multiple sales channels, including mobile, web, social media, marketplaces, brick-and-mortar locations, and pop-up shops. The platform also provides merchants with a powerful back-office and a single view of...