LLM Performance Operation

2 weeks ago


Singapore BYTEDANCE PTE. LTD. Full time
Roles & Responsibilities

About ByteDance

Established in 2012, ByteDance is on a mission to spark creativity and enhance life. With a range of over a dozen products like TikTok, Helo, and Resso, along with platforms tailored for the Chinese market such as Toutiao, Douyin, and Xigua, ByteDance has simplified and made it more enjoyable for individuals to engage with, consume, and develop content.

Why Choose Us

Creativity lies at the heart of ByteDance's mission. Our products are designed to foster imaginative thinking. This remains true for the teams behind our groundbreaking innovations. Together, we fuel creativity and enhance lives - a mission we strive to fulfill each day. Any challenge, no matter how complex, is viewed as an opportunity for us; an opportunity to learn, innovate, and grow as a unified team. Accepting the status quo? Never. Embracing courage? Always. At ByteDance, we create and evolve together. This is how we make a difference - for ourselves, our organization, and the individuals we cater to. Come and be a part of our journey.

As a vital member of our LLM Global Data Team, you will be central to our operations. You will gain hands-on experience in comprehending and evaluating the performance of LLM across various aspects.

Your Responsibilities Will Include:

  • Acquiring direct exposure to LLM and LLM-related product performance assessment, involving the development of metrics, planning and executing tests to aid tech and product teams in grasping LLM and product performance.
  • Furnishing performance and feedback analyses to pinpoint issues in LLM training and product design.
  • Collaborating with product managers and engineers to construct testing procedures, establish feedback mechanisms, and elevate the efficiency of testing protocols and criteria.
  • Working closely with the annotation team to assess the quality of training datasets.

Requirements:

  • Proficiency in English with exceptional or native-level writing and evaluation abilities. Candidates fluent in multiple languages are preferred.
  • Essential critical thinking and analytical skills. Background in consulting, market research, auditing, operational process enhancement, and design is appreciated. Prior experience as NLP model and search product performance evaluators is highly advantageous.
  • Ability to meet deadlines comfortably and generate innovative solutions, incorporating the use of technology and tools to elevate the quality of individual and team outputs.
  • A keen interest in LLM is a must. The ideal candidate is an avid learner who finds interaction with diverse case studies enriching.
  • Note: Prior to interviews, a written examination is essential for this role.

ByteDance is dedicated to fostering an inclusive environment where employees are recognized for their expertise, backgrounds, and distinct viewpoints. Our platform unites individuals worldwide, and so does our workplace. At ByteDance, our mission is to ignite creativity and enrich lives. To accomplish this objective, we are devoted to acknowledging our diverse voices and establishing an atmosphere that mirrors the numerous communities we engage with. We are deeply passionate about this endeavor and hope you share the same enthusiasm.

Tell employers what skills you have

Market Research
Microsoft Office
Microsoft Excel
Dashboard
Collaborating With Product Managers
Data Analysis
Product Design
Analytical Skills
Critical Thinking
Supply Chain
Auditing
Multilingual
SAP
Accounting
Writing
Consulting



  • Singapore BYTEDANCE PTE. LTD. Full time

    ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...


  • Singapore BYTEDANCE PTE. LTD. Full time

    About ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...


  • Singapore ByteDance Full time

    About ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceEstablished in 2012, ByteDance's mission is to spark creativity and enhance life. With a range of over a dozen products, such as TikTok, Helo, and Resso, along with platforms tailored to the Chinese market like Toutiao, Douyin, and Xigua, ByteDance has simplified and made more enjoyable the process for people to connect...


  • Singapore BYTEDANCE PTE. LTD. Full time

    About ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...


  • Singapore ByteDance Full time

    About ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceByteDance, established in 2012, is dedicated to igniting creativity and enhancing life. The company offers a range of more than a dozen products, such as TikTok, Helo, and Resso, tailored to different markets like Toutiao, Douyin, and Xigua in China. ByteDance has simplified and made connecting, consuming, and crafting...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...