LLM Performance Operations Specialist
1 month ago
As a key member of our LLM Global Data Team, you will be at the forefront of our operations, gaining hands-on experience in understanding how to measure and analyze the performance of LLM on various dimensions.
Your Key Responsibilities- Create and implement metrics to measure LLM performance, design and conduct tests to help tech and product teams understand LLM and product performance.
- Deliver performance and feedback analysis to identify issues in LLM training and product design, collaborating with product managers and engineers to build testing workflows and enhance testing processes.
- Work closely with the annotation team to gauge the quality of training data sets.
We're seeking a professional with:
- Professional proficiency in English with excellent writing and critique skills.
- Critical thinking and analytical skills.
- Comfort with meeting deadlines and generating creative solutions to enhance the quality of individual and team outputs.
Preferred qualifications include experience in consulting, market research, auditing, operational process design and improvement, as well as a deep interest in LLM and enthusiasm for diverse case studies.
About ByteDanceByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe, and so does our workplace. We're passionate about inspiring creativity and enriching life, and we're looking for like-minded individuals to join us.
-
LLM Model Performance Operations Specialist
2 weeks ago
Singapore BYTEDANCE PTE. LTD. Full timeLLM Model Performance Operations Specialist Job SummaryThis is a core member of our LLM Global Data Team, responsible for understanding and analyzing the performance of LLM on various dimensions. The ideal candidate has professional proficiency in English, critical thinking, and analytical skills, with a deep interest in LLM and a passion for...
-
LLM Performance Operation, Specialist
2 weeks ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to...
-
LLM Performance Operation, Analysts
2 months ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to...
-
LLM Performance Analyst
2 months ago
Singapore BYTEDANCE PTE. LTD. Full time{"h1": "LLM Performance Analyst", "h2": "About the Role", "p": "As a key member of ByteDance\u2019s LLM Global Data Team, you will gain hands-on experience in measuring and analyzing the performance of Large Language Models (LLM) on various dimensions.Your responsibilities will include creating metrics, designing and conducting tests, and delivering...
-
LLM Performance Analyst
2 months ago
Singapore BYTEDANCE PTE. LTD. Full time{"h1": "LLM Performance Analyst", "h2": "About the Role", "p": "As a key member of ByteDance\u2019s LLM Global Data Team, you will gain hands-on experience in measuring and analyzing the performance of Large Language Models (LLM) on various dimensions.Your responsibilities will include creating metrics, designing and conducting tests, and delivering...
-
LLM Data Specialist
2 weeks ago
Singapore BYTEDANCE PTE. LTD. Full timeAbout ByteDance Pte. Ltd.ByteDance Pte. Ltd. is a global technology company that is proud to have a diverse range of innovative products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua.We are seeking a skilled Content Curation Specialist for Large Language Models (LLMs) to join our...
-
Senior ai engineer
3 days ago
Singapore HAYS SPECIALIST RECRUITMENT PTE. LTD. Full timeA leading technology organisation is seeking a Senior AI Engineer (LLM / NLP) with 2-5 years of hands-on experience in NLP solution development, particularly in NLP solution design, development and deployment. The role involves applying NLP knowledge to develop Gen AI solutions, leveraging on a machine learning framework, not limited to Tensorflow,...
-
LLM Training Operation
2 weeks ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...
-
LLM Training Operation
5 months ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...
-
LLM Training Operation
2 weeks ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...
-
LLM Training Operation
2 weeks ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...
-
LLM Training Operation
2 weeks ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilitiesAbout ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to...
-
LLM Training Operation
2 weeks ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilitiesAbout ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to...
-
AI Research Scientist
7 days ago
Singapore TikTok Full timeAbout The TeamWe are a group of innovators working on cutting-edge AI technologies at TikTok's Eng-AI Innovation Center. Our mission is to explore the possibilities of Large Language Models (LLM) and their applications in various domains.Job DescriptionWe are seeking talented researchers to join our team in the development of LLM Agent platform. The ideal...
-
Research Scientist
2 months ago
Singapore NTU (Nanyang Technology University- Main Office-HR) Full timeA Corp Lab in NTU is looking for a motivated Research Scientist to conduct cutting-edge research in the topic of "Green Cloud Computing", who will lead groundbreaking research in applying Large Language Models (LLMs) to enhance the design, operation, and optimization of data centers.Key Responsibilities:Lead and manage research focused on developing and...
-
LLM Architect
2 weeks ago
Singapore BRIGHTOIL PETROLEUM (S'PORE) PTE. LTD. Full timeRoles & ResponsibilitiesDescriptions: Design and optimize large language models, devise fine-tuning strategies, and streamline the training process. Explore deep learning architectures like Seq2Seq, Transformer, and advanced techniques including Fine-tuning, Prompt Engineering, and Soft Prompting (SFT). Develop systems for efficient model training and...
-
Performance engineer
6 hours ago
Singapore BARGHEST BUILDING PERFORMANCE PTE. LTD. Full timeThis role will report to the Performance Manager. Main Responsibilities Subject Matter Expert / Design & Solutions Conduct detailed performance analysis of HVAC systems to identify inefficiencies and areas for improvement. Develop and implement energy simulation techniques to evaluate system performance. Perform energy audits and assess compliance with...
-
Senior Product Performance Engineer
2 weeks ago
Singapore DYSON OPERATIONS PTE. LTD. Full timeRoles & ResponsibilitiesAbout UsDyson is a global technology enterprise. We solve the problems others choose to ignore, with surprising new inventions that defy convention and simply work better.We push the boundaries of what others have defined as possible. Our approach starts with an engineering mindset and different thinking. Then we continuously refine...
-
Product Operations Manager
2 weeks ago
Singapore TikTok Full timeTeam IntroductionAt TikTok, we're driving the evolution of AI with groundbreaking advancements in AIGC/LLM technologies. As an AI/LLM Operations Specialist, you'll play a pivotal role in the training, evaluation, and optimization of AI models, focusing on content moderation. This role offers a unique opportunity to develop comprehensive skills spanning...
-
Senior AI Engineer
1 week ago
Singapore Hays Full timeYour new role Your new role as a Senior NLP Engineer (LLM /NLP), you will be responsible for: Work closely with subject-matter experts to incorporate NLP components into existing systems and applications. Conduct independent research to refine and enhance product evaluation suites, ensuring accurate measurement of model and product performance. Engage in...