Global LLM Performance Analyst

5 days ago


Singapore BYTEDANCE PTE. LTD. Full time

About the Role

We are seeking a skilled Global LLM Performance Analyst to join our team at ByteDance PTE. LTD. This is a full-time position, with an estimated annual salary of $120,000 - $180,000.

Job Description:

The successful candidate will be responsible for measuring and analyzing the performance of Large Language Models (LLM) on various dimensions. They will work closely with product managers and engineers to build testing workflows, create feedback loops, and enhance the effectiveness of testing processes and standards.

Key Responsibilities:

  • Gaining direct experience in LLM and LLM-relevant product performance measurement, including creating metrics, designing and conducting tests, to help tech and product teams understand LLM and product performance.
  • D Delivering performance and feedback analysis to identify issues in LLM training and product design.
  • Collaborating with product managers and engineers to build testing workflows, create feedback loops, and enhance the effectiveness of testing processes and standards.
  • Working closely with the annotation team to gauge the quality of training data sets.

Requirements:

To succeed in this role, you will need:

  • Professional proficiency in English with excellent writing and critique skills.
  • Critical thinking and analytical skills are required.
  • Comfort with meeting deadlines and generating creative solutions, including the use of technology and tools, to enhance the quality of both individual and team outputs.

Preferred Qualifications:

  • Experience in consulting, market research, auditing, operational process design and improvement is valued. Experience as NLP model and search product performance evaluators is strongly preferred.
  • A deep interest in LLM is essential. The ideal candidate is an enthusiastic learner who finds engagement with diverse case studies stimulating.

Note: This role requires a paper test prior to interviews. You may be exposed to harmful content as part of your core role or project work.



  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...


  • Singapore BYTEDANCE PTE. LTD. Full time

    About UsByteDance PTE. LTD., a pioneering tech firm, empowers creativity and enriches life through innovative products like TikTok and Helo.Role OverviewWe're seeking an exceptional AI Performance Operations Analyst to join our LLM Global Data Team. This role offers the chance to drive impact by analyzing and optimizing performance metrics, collaborating...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...


  • Singapore TIKTOK PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilitiesTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.Why Join UsCreation is the core of TikTok's purpose. Our platform is built to...


  • Singapore AD ASTRA CONSULTANTS PRIVATE LTD. Full time

    Job DescriptionWe are seeking a highly skilled Global Policy Analyst - Advertising Compliance to join our team at AD ASTRA CONSULTANTS PRIVATE LTD.About the RoleThe successful candidate will be responsible for developing, implementing, and enforcing scalable Ads & Shopping policies across multiple geographies. This role requires a strong understanding of...


  • Singapore BYTEDANCE PTE. LTD. Full time

    About the RoleThis is a challenging and rewarding opportunity for a skilled AI performance optimization specialist to join our LLM Global Data Team at BYTEDANCE PTE. LTD.Key Responsibilities- Collaborate with product managers and engineers to design and conduct tests to measure and analyze LLM performance on various dimensions- Deliver performance and...


  • Singapore TIKTOK PTE. LTD. Full time

    Roles & ResponsibilitiesTikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and its offices include New York, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.Why Join Us Creation is the core of TikTok's...


  • Singapore Global Schools Foundation Full time

    Job Title: Senior Financial Analyst - Global Campus OperationsJob Summary:We are seeking a highly skilled Senior Financial Analyst to join our team in Global Campus Operations. The successful candidate will be responsible for analyzing financial data, managing treasury functions, and preparing MIS reports.Key Responsibilities:Preparation and analysis of MIS...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Unlock your potential in the world of Large Language Models (LLMs) as a key member of our global data team at BYTEDANCE PTE. LTD.About the Role:We are seeking a skilled Lead LLM Data Generation Specialist to join our team. In this exciting role, you will be responsible for ensuring the quality and integrity of our coding data, collaborating with product...

  • AI Research Scientist

    1 month ago


    Singapore TikTok Full time

    About The TeamWe are a group of innovators working on cutting-edge AI technologies at TikTok's Eng-AI Innovation Center. Our mission is to explore the possibilities of Large Language Models (LLM) and their applications in various domains.Job DescriptionWe are seeking talented researchers to join our team in the development of LLM Agent platform. The ideal...


  • Singapore BYTEDANCE PTE. LTD. Full time

    About UsAt BYTEDANCE PTE. LTD., our mission is to inspire creativity and enrich life. As a company with a suite of over a dozen innovative products, including TikTok, Helo, and Resso, we aim to make it easier and more enjoyable for people to connect with, consume, and create content.We are seeking an exceptional professional to join our LLM Global Data Team...


  • Singapore SUNWIN GLOBAL TRADING PTE. LTD. Full time

    Company Overview:Sunwin Global Trading Pte. Ltd. is a leading trading company seeking an experienced High-Performance IT Strategist to join its technology team.The ideal candidate will possess strong technical expertise in low-latency trading systems, risk management software, data analytics, and cybersecurity.This role requires exceptional problem-solving...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...

  • LLM Coding Trainer

    4 weeks ago


    Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...


  • Singapore BYTEDANCE PTE. LTD. Full time

    About BYTEDANCE PTE. LTD.BYTEDANCE PTE. LTD., a leading technology company, is dedicated to inspiring creativity and enriching life. Founded in 2012, we have made it easier and more fun for people to connect with, consume, and create content through our products, including TikTok, Helo, Resso, Toutiao, Douyin, Xigua, and more.At BYTEDANCE PTE. LTD., we...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...

  • Product Manager

    6 days ago


    Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...


  • Singapore DELL GLOBAL B.V. (SINGAPORE BRANCH) Full time

    Job SummaryWe are seeking a Senior Analyst, Global Supply Management to join our team in Singapore. This role is responsible for global supply planning for specific platforms and commodity areas. The successful candidate will ensure sourcing efforts meet business goals and objectives and engage activities related to global sourcing, supplier selection,...


  • Singapore TikTok Full time

    About the RoleCompany OverviewTikTok is a leading social media platform that empowers users to create and share content. Our Eng-AI Innovation Center is dedicated to pushing the boundaries of Artificial General Intelligence (AGI) to enhance user experiences, improve content understanding, and defend against internet abuse.Job DescriptionWe are seeking a...


  • Singapore IQIYI INTERNATIONAL SINGAPORE PTE. LTD. Full time $900 - $1,300

    Job Responsibilities: Explore sota methods to enhance performance and efficiency of AI models (such as LLM, speech models, etc).Research areas include but are not limited to generative models, NLP, ASR, TTS, etc. Position Requirements: Proficient in deep learning algorithms with research in the direction of NLP or speech models, experience in...