remote llm evaluator

Job offers for remote llm evaluator. Find listings updated daily.


  • singapore UMELIFE (SINGAPORE) PTE. LTD. Full-time

    UMELIFE (SINGAPORE) PTE. LTD. seeks an AI evaluation engineer to build and maintain an automated LLM evaluation pipeline covering general capabilities, agent capabilities, and persona/role-playing evaluations with one-click assessment and regression testing. You will execute benchmarks such as MMLU, C-Eval, HumanEval, GSM8K, MATH, and IFEval, manage results...

  • LLM Evaluation

    22 hours ago


    singapore TikTok Inc. Full-time

    TikTok is seeking a Product Operations Specialist to join the Tako team in Singapore. You will design and implement an evaluation framework for the in-app AI chatbot, bridging user insights, data analysis, and cross-functional execution to drive product improvements. You will leverage user research to set quality standards, work with strategy and algorithm...

  • AI Evaluation Engineer

    19 hours ago


    singapore Aimlroles Full-time

    The National Centre for Research in Digital Trust (DTC) at NTU seeks a Research Engineer to support evaluation and validation of AI systems. You will design evaluation methods, build test datasets, and analyze performance in real-world conditions. You will collaborate with external partners, run experiments with large language models, develop prototypes and...

  • Large Language Model

    19 hours ago


    singapore KUAILU SOFTWARE (SINGAPORE) PTE. LTD. Full-time

    Job Responsibilities Build and maintain an automated LLM evaluation pipeline covering multiple dimensions, including general capabilities, Agent capabilities, and persona/role-playing. The pipeline should support one-click evaluation, historical result comparison, and regression testing. Conduct general capability evaluations using benchmarks such as MMLU,...


  • singapore KUAILU SOFTWARE (SINGAPORE) PTE. LTD. Full-time

    KUAILU SOFTWARE (SINGAPORE) PTE. LTD. seeks a capable engineer to build and maintain an automated LLM evaluation pipeline across general, agent, and persona settings, enabling one-click evaluation and regression testing. You will run benchmarks like MMLU, C-Eval, HumanEval, GSM8K, MATH, and IFEval; set up evaluation environments, track metrics, analyze...


  • singapore Nanyang Technological University Full-time

    NTU Singapore’s AISG invites a capable researcher to join as an AI evaluation specialist with a focus on multilingual, multicultural, and multimodal LLM evaluation. You will build and maintain evaluation frameworks, collect and translate evaluation data, and collaborate with partners to ensure reliable AI solutions. You should hold a degree in CS/AI/data...


  • workfromhome, singapore Binance Full-time

    Binance is seeking an evaluation expert with an algorithmic background to build LLM evaluation capabilities across dialogue, financial trading, and other scenarios, using professional evaluation methods to quantify model performance and guide R&D. You will design end-to-end evaluation plans, build datasets, and drive automation of evaluation workflows in a...

  • Large Language Model

    19 hours ago


    singapore UMELIFE (SINGAPORE) PTE. LTD. Full-time

    Job Responsibilities Build and maintain an automated LLM evaluation pipeline covering multiple dimensions, including general capabilities, Agent capabilities, and persona/role-playing. The pipeline should support one-click evaluation, historical result comparison, and regression testing. Conduct general capability evaluations using benchmarks such as...


  • singapore TikTok Inc. Full-time

    Responsibilities About the Team: We are looking for a sharp and organized Product Operations specialist to join TikTok's Tako team. You will play a key role in building and operationalizing the evaluation framework for Tako's in-app AI chatbot experience, bridging user insights, data analysis, and cross-functional execution to drive continuous product...

  • AI Product Manager

    22 hours ago


    singapore, sg ByteDance Full-time

    ResponsibilitiesAbout The Team The Security Engineering team designs, builds, and maintains ByteDance's global security infrastructure, platforms, and services.Our core responsibility is to develop scalable systems and tools that enable secure product operations across the company. By delivering reliable, high-performance security solutions, the team...

  • AI Product Manager

    1 day ago


    singapore Byte Dance Full-time

    ResponsibilitiesAbout The Team The Security Engineering team designs, builds, and maintains ByteDance's global security infrastructure, platforms, and services. Our core responsibility is to develop scalable systems and tools that enable secure product operations across the company. By delivering reliable, high-performance security solutions, the team...


  • singapore Bitdeer Technologies Group Full-time

    About Bitdeer: Bitdeer is a world-leading technology company for Bitcoin mining and AI cloud.Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers. Apart from designing industry-leading ASIC chips and manufacturing mining rigs, the Group handles complex processes involved in computing across the value chain. This...


  • singapore TikTok Full-time

    Responsibilities About the Team: We are looking for a sharp and organized Product Operations specialist to join TikTok's Tako team. You will play a key role in building and operationalizing the evaluation framework for Tako's in-app AI chatbot experience, bridging user insights, data analysis, and cross-functional execution to drive continuous product...


  • Singapore Binance Remote Full-time

    Binance is seeking an evaluation expert with an algorithmic background to build LLM evaluation capabilities across dialogue, financial trading, and other scenarios, using professional evaluation methods to quantify model performance and guide R&D.You will design end-to-end evaluation plans, build datasets, and drive automation of evaluation workflows in a...

  • AI Product Manager

    2 days ago


    singapore ByteDance Full-time

    Responsibilities About The Team The Security Engineering team designs, builds, and maintains ByteDance's global security infrastructure, platforms, and services. Our core responsibility is to develop scalable systems and tools that enable secure product operations across the company. By delivering reliable, high-performance security solutions, the team...


  • singapore Nicoll Curtin Full-time

    Nicoll Curtin is seeking specialists to evaluate speech recordings and improve speech dataset quality. This is a remote contract based in Singapore, running until 31 March 2027 with potential extension. You will evaluate audio for tone, naturalness and fidelity, compare samples, and develop guidelines for consistent annotations. Responsibilities include...


  • singapore Crossing Hurdles Full-time

    Crossing Hurdles is seeking a remote contractor to evaluate Chinese audio samples for nativeness, fluency, and linguistic authenticity. You will assess pronunciation and intonation, then provide clear feedback in English on linguistic strengths and areas for improvement. Applicants should have native or near-native Mandarin, at least B2 English proficiency,...

  • French AI Trainer

    21 hours ago


    singapore Prolific Full-time

    Prolific is seeking Advanced French Speakers to help train and evaluate cutting-edge AI models. You will perform tasks involving analyzing, editing, and writing in French and may be invited to join as a Domain Expert participant with paid tasks and flexible hours. This remote role requires a reliable internet connection and self-employment for earnings....


  • Singapore rws Remote Full-time

    RWS is seeking an AI Linguistic Quality Evaluator to assess Hindi-language outputs for a long‑term collaboration. You will audit multilingual AI responses for accuracy, cultural relevance, and usefulness, scoring them against local guidelines.This flexible remote role welcomes students, grads, or professionals seeking project-based work. Ideal candidates...


  • singapore, sg Bitdeer Full-time

    About Bitdeer: Bitdeer is a world‑leading technology company for Bitcoin mining and AI cloud. Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers. Apart from designing industry‑leading ASIC chips and manufacturing mining rigs, the Group handles complex processes involved in computing across the value chain. This...