Global LLM Performance Analyst
5 days ago
About the Role
We are seeking a skilled Global LLM Performance Analyst to join our team at ByteDance PTE. LTD. This is a full-time position, with an estimated annual salary of $120,000 - $180,000.
Job Description:
The successful candidate will be responsible for measuring and analyzing the performance of Large Language Models (LLM) on various dimensions. They will work closely with product managers and engineers to build testing workflows, create feedback loops, and enhance the effectiveness of testing processes and standards.
Key Responsibilities:
- Gaining direct experience in LLM and LLM-relevant product performance measurement, including creating metrics, designing and conducting tests, to help tech and product teams understand LLM and product performance.
- D Delivering performance and feedback analysis to identify issues in LLM training and product design.
- Collaborating with product managers and engineers to build testing workflows, create feedback loops, and enhance the effectiveness of testing processes and standards.
- Working closely with the annotation team to gauge the quality of training data sets.
Requirements:
To succeed in this role, you will need:
- Professional proficiency in English with excellent writing and critique skills.
- Critical thinking and analytical skills are required.
- Comfort with meeting deadlines and generating creative solutions, including the use of technology and tools, to enhance the quality of both individual and team outputs.
Preferred Qualifications:
- Experience in consulting, market research, auditing, operational process design and improvement is valued. Experience as NLP model and search product performance evaluators is strongly preferred.
- A deep interest in LLM is essential. The ideal candidate is an enthusiastic learner who finds engagement with diverse case studies stimulating.
Note: This role requires a paper test prior to interviews. You may be exposed to harmful content as part of your core role or project work.
-
LLM Performance Operation, Analysts
4 weeks ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...
-
AI Performance Operations Analyst
2 days ago
Singapore BYTEDANCE PTE. LTD. Full timeAbout UsByteDance PTE. LTD., a pioneering tech firm, empowers creativity and enriches life through innovative products like TikTok and Helo.Role OverviewWe're seeking an exceptional AI Performance Operations Analyst to join our LLM Global Data Team. This role offers the chance to drive impact by analyzing and optimizing performance metrics, collaborating...
-
LLM Training Operation
4 weeks ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...
-
Tech Expert/Backend Engineer
3 months ago
Singapore TIKTOK PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilitiesTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.Why Join UsCreation is the core of TikTok's purpose. Our platform is built to...
-
Global Policy Analyst
3 days ago
Singapore AD ASTRA CONSULTANTS PRIVATE LTD. Full timeJob DescriptionWe are seeking a highly skilled Global Policy Analyst - Advertising Compliance to join our team at AD ASTRA CONSULTANTS PRIVATE LTD.About the RoleThe successful candidate will be responsible for developing, implementing, and enforcing scalable Ads & Shopping policies across multiple geographies. This role requires a strong understanding of...
-
AI Performance Optimization Specialist
3 days ago
Singapore BYTEDANCE PTE. LTD. Full timeAbout the RoleThis is a challenging and rewarding opportunity for a skilled AI performance optimization specialist to join our LLM Global Data Team at BYTEDANCE PTE. LTD.Key Responsibilities- Collaborate with product managers and engineers to design and conduct tests to measure and analyze LLM performance on various dimensions- Deliver performance and...
-
Tech Expert/Backend Engineer
1 month ago
Singapore TIKTOK PTE. LTD. Full timeRoles & ResponsibilitiesTikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and its offices include New York, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.Why Join Us Creation is the core of TikTok's...
-
Senior Financial Analyst
1 month ago
Singapore Global Schools Foundation Full timeJob Title: Senior Financial Analyst - Global Campus OperationsJob Summary:We are seeking a highly skilled Senior Financial Analyst to join our team in Global Campus Operations. The successful candidate will be responsible for analyzing financial data, managing treasury functions, and preparing MIS reports.Key Responsibilities:Preparation and analysis of MIS...
-
Lead LLM Data Generation Specialist
3 days ago
Singapore BYTEDANCE PTE. LTD. Full timeUnlock your potential in the world of Large Language Models (LLMs) as a key member of our global data team at BYTEDANCE PTE. LTD.About the Role:We are seeking a skilled Lead LLM Data Generation Specialist to join our team. In this exciting role, you will be responsible for ensuring the quality and integrity of our coding data, collaborating with product...
-
AI Research Scientist
1 month ago
Singapore TikTok Full timeAbout The TeamWe are a group of innovators working on cutting-edge AI technologies at TikTok's Eng-AI Innovation Center. Our mission is to explore the possibilities of Large Language Models (LLM) and their applications in various domains.Job DescriptionWe are seeking talented researchers to join our team in the development of LLM Agent platform. The ideal...
-
Data Operations Manager
4 hours ago
Singapore BYTEDANCE PTE. LTD. Full timeAbout UsAt BYTEDANCE PTE. LTD., our mission is to inspire creativity and enrich life. As a company with a suite of over a dozen innovative products, including TikTok, Helo, and Resso, we aim to make it easier and more enjoyable for people to connect with, consume, and create content.We are seeking an exceptional professional to join our LLM Global Data Team...
-
Singapore SUNWIN GLOBAL TRADING PTE. LTD. Full timeCompany Overview:Sunwin Global Trading Pte. Ltd. is a leading trading company seeking an experienced High-Performance IT Strategist to join its technology team.The ideal candidate will possess strong technical expertise in low-latency trading systems, risk management software, data analytics, and cybersecurity.This role requires exceptional problem-solving...
-
LLM Coding Trainer, Specialist
4 weeks ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...
-
LLM Coding Trainer
4 weeks ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...
-
Data Quality Assurance Specialist
5 days ago
Singapore BYTEDANCE PTE. LTD. Full timeAbout BYTEDANCE PTE. LTD.BYTEDANCE PTE. LTD., a leading technology company, is dedicated to inspiring creativity and enriching life. Founded in 2012, we have made it easier and more fun for people to connect with, consume, and create content through our products, including TikTok, Helo, Resso, Toutiao, Douyin, Xigua, and more.At BYTEDANCE PTE. LTD., we...
-
Product Manager, LLM Training
6 days ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...
-
Product Manager
6 days ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...
-
Global Supply Chain Strategist
3 days ago
Singapore DELL GLOBAL B.V. (SINGAPORE BRANCH) Full timeJob SummaryWe are seeking a Senior Analyst, Global Supply Management to join our team in Singapore. This role is responsible for global supply planning for specific platforms and commodity areas. The successful candidate will ensure sourcing efforts meet business goals and objectives and engage activities related to global sourcing, supplier selection,...
-
Senior LLM Engineer for Next-Generation AI
2 weeks ago
Singapore TikTok Full timeAbout the RoleCompany OverviewTikTok is a leading social media platform that empowers users to create and share content. Our Eng-AI Innovation Center is dedicated to pushing the boundaries of Artificial General Intelligence (AGI) to enhance user experiences, improve content understanding, and defend against internet abuse.Job DescriptionWe are seeking a...
-
LLM Algorithm Intern
1 day ago
Singapore IQIYI INTERNATIONAL SINGAPORE PTE. LTD. Full time $900 - $1,300Job Responsibilities: Explore sota methods to enhance performance and efficiency of AI models (such as LLM, speech models, etc).Research areas include but are not limited to generative models, NLP, ASR, TTS, etc. Position Requirements: Proficient in deep learning algorithms with research in the direction of NLP or speech models, experience in...