remote llm evaluator
Job offers for remote llm evaluator. Find listings updated daily.
-
LLM Evaluation Engineer – Benchmarking
19 hours ago
singapore UMELIFE (SINGAPORE) PTE. LTD. Full-timeUMELIFE (SINGAPORE) PTE. LTD. seeks an AI evaluation engineer to build and maintain an automated LLM evaluation pipeline covering general capabilities, agent capabilities, and persona/role-playing evaluations with one-click assessment and regression testing. You will execute benchmarks such as MMLU, C-Eval, HumanEval, GSM8K, MATH, and IFEval, manage results...
-
LLM Evaluation
22 hours ago
singapore TikTok Inc. Full-timeTikTok is seeking a Product Operations Specialist to join the Tako team in Singapore. You will design and implement an evaluation framework for the in-app AI chatbot, bridging user insights, data analysis, and cross-functional execution to drive product improvements. You will leverage user research to set quality standards, work with strategy and algorithm...
-
AI Evaluation Engineer
19 hours ago
singapore Aimlroles Full-timeThe National Centre for Research in Digital Trust (DTC) at NTU seeks a Research Engineer to support evaluation and validation of AI systems. You will design evaluation methods, build test datasets, and analyze performance in real-world conditions. You will collaborate with external partners, run experiments with large language models, develop prototypes and...
-
Large Language Model
19 hours ago
singapore KUAILU SOFTWARE (SINGAPORE) PTE. LTD. Full-timeJob Responsibilities Build and maintain an automated LLM evaluation pipeline covering multiple dimensions, including general capabilities, Agent capabilities, and persona/role-playing. The pipeline should support one-click evaluation, historical result comparison, and regression testing. Conduct general capability evaluations using benchmarks such as MMLU,...
-
LLM Evaluation Engineer: Benchmarking
19 hours ago
singapore KUAILU SOFTWARE (SINGAPORE) PTE. LTD. Full-timeKUAILU SOFTWARE (SINGAPORE) PTE. LTD. seeks a capable engineer to build and maintain an automated LLM evaluation pipeline across general, agent, and persona settings, enabling one-click evaluation and regression testing. You will run benchmarks like MMLU, C-Eval, HumanEval, GSM8K, MATH, and IFEval; set up evaluation environments, track metrics, analyze...
-
LLM Evaluation Engineer – Multilingual AI Metrics
19 hours ago
singapore Nanyang Technological University Full-timeNTU Singapore’s AISG invites a capable researcher to join as an AI evaluation specialist with a focus on multilingual, multicultural, and multimodal LLM evaluation. You will build and maintain evaluation frameworks, collect and translate evaluation data, and collaborate with partners to ensure reliable AI solutions. You should hold a degree in CS/AI/data...
-
Senior LLM Evaluation Engineer
19 hours ago
workfromhome, singapore Binance Full-timeBinance is seeking an evaluation expert with an algorithmic background to build LLM evaluation capabilities across dialogue, financial trading, and other scenarios, using professional evaluation methods to quantify model performance and guide R&D. You will design end-to-end evaluation plans, build datasets, and drive automation of evaluation workflows in a...
-
Large Language Model
19 hours ago
singapore UMELIFE (SINGAPORE) PTE. LTD. Full-timeJob Responsibilities Build and maintain an automated LLM evaluation pipeline covering multiple dimensions, including general capabilities, Agent capabilities, and persona/role-playing. The pipeline should support one-click evaluation, historical result comparison, and regression testing. Conduct general capability evaluations using benchmarks such as...
-
singapore TikTok Inc. Full-timeResponsibilities About the Team: We are looking for a sharp and organized Product Operations specialist to join TikTok's Tako team. You will play a key role in building and operationalizing the evaluation framework for Tako's in-app AI chatbot experience, bridging user insights, data analysis, and cross-functional execution to drive continuous product...
-
AI Product Manager
22 hours ago
singapore, sg ByteDance Full-timeResponsibilitiesAbout The Team The Security Engineering team designs, builds, and maintains ByteDance's global security infrastructure, platforms, and services.Our core responsibility is to develop scalable systems and tools that enable secure product operations across the company. By delivering reliable, high-performance security solutions, the team...
-
AI Product Manager
1 day ago
singapore Byte Dance Full-timeResponsibilitiesAbout The Team The Security Engineering team designs, builds, and maintains ByteDance's global security infrastructure, platforms, and services. Our core responsibility is to develop scalable systems and tools that enable secure product operations across the company. By delivering reliable, high-performance security solutions, the team...
-
Senior LLM Performance
3 days ago
singapore Bitdeer Technologies Group Full-timeAbout Bitdeer: Bitdeer is a world-leading technology company for Bitcoin mining and AI cloud.Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers. Apart from designing industry-leading ASIC chips and manufacturing mining rigs, the Group handles complex processes involved in computing across the value chain. This...
-
singapore TikTok Full-timeResponsibilities About the Team: We are looking for a sharp and organized Product Operations specialist to join TikTok's Tako team. You will play a key role in building and operationalizing the evaluation framework for Tako's in-app AI chatbot experience, bridging user insights, data analysis, and cross-functional execution to drive continuous product...
-
Senior LLM Evaluation Engineer
2 days ago
Singapore Binance Remote Full-timeBinance is seeking an evaluation expert with an algorithmic background to build LLM evaluation capabilities across dialogue, financial trading, and other scenarios, using professional evaluation methods to quantify model performance and guide R&D.You will design end-to-end evaluation plans, build datasets, and drive automation of evaluation workflows in a...
-
AI Product Manager
2 days ago
singapore ByteDance Full-timeResponsibilities About The Team The Security Engineering team designs, builds, and maintains ByteDance's global security infrastructure, platforms, and services. Our core responsibility is to develop scalable systems and tools that enable secure product operations across the company. By delivering reliable, high-performance security solutions, the team...
-
Remote Speech Quality Evaluator – Multilingual
19 hours ago
singapore Nicoll Curtin Full-timeNicoll Curtin is seeking specialists to evaluate speech recordings and improve speech dataset quality. This is a remote contract based in Singapore, running until 31 March 2027 with potential extension. You will evaluate audio for tone, naturalness and fidelity, compare samples, and develop guidelines for consistent annotations. Responsibilities include...
-
Mandarin-English Audio Evaluator
19 hours ago
singapore Crossing Hurdles Full-timeCrossing Hurdles is seeking a remote contractor to evaluate Chinese audio samples for nativeness, fluency, and linguistic authenticity. You will assess pronunciation and intonation, then provide clear feedback in English on linguistic strengths and areas for improvement. Applicants should have native or near-native Mandarin, at least B2 English proficiency,...
-
French AI Trainer
21 hours ago
singapore Prolific Full-timeProlific is seeking Advanced French Speakers to help train and evaluate cutting-edge AI models. You will perform tasks involving analyzing, editing, and writing in French and may be invited to join as a Domain Expert participant with paid tasks and flexible hours. This remote role requires a reliable internet connection and self-employment for earnings....
-
Remote Hindi AI Quality Evaluator
3 days ago
Singapore rws Remote Full-timeRWS is seeking an AI Linguistic Quality Evaluator to assess Hindi-language outputs for a long‑term collaboration. You will audit multilingual AI responses for accuracy, cultural relevance, and usefulness, scoring them against local guidelines.This flexible remote role welcomes students, grads, or professionals seeking project-based work. Ideal candidates...
-
Senior LLM Inference Performance
4 days ago
singapore, sg Bitdeer Full-timeAbout Bitdeer: Bitdeer is a world‑leading technology company for Bitcoin mining and AI cloud. Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers. Apart from designing industry‑leading ASIC chips and manufacturing mining rigs, the Group handles complex processes involved in computing across the value chain. This...