Model Evaluation Specialist

5 days ago


Singapore TikTok Full time

Responsibilities
TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa.

TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.

Why Join Us?
Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible. Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day. To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.
Join us.

Our Trust & Safety team's commitment is to keep our online community safe. We have invested heavily in human and machine-based moderation to remove harmful content quickly and often before it reaches our general community.

What will I be doing?
Our mission is to build a world where people can safely discover, create and connect. The Evaluation and Investigation team is responsible for evaluating and assessing the quality of AI models under TikTok and other international products, to ensure product security and create a good atmosphere for content creation and community interaction. You will have the opportunity to join the fast-growing space of AI and contribute to the development of cutting-edge products.

As a Model Evaluation Specialist, you will conduct rigorous assessments of AI model quality in accordance with evaluation standard documents. You will identify bad model cases and determine the overall model quality based on your findings. In the course of your work, you may be tasked to evaluate a range of AI projects with different focus areas.

**Responsibilities**:

- Complete regular assessments relating to AI model quality in accordance with evaluation standard documents.
- Use evaluation methods to complete daily strategy assessment of AI model quality in accordance with evaluation standard documents.
- Comb the types of AI model bad cases and rate the quality of the results.
- While it is assumed the evaluator will focus on their area of expertise, there will be occasions in which he/she will work on projects outside this core area that could require other capabilities, such as using assessment methods flexibly to support related projects.
- Willing to work with sensitive issues that include child exploitation, a variety of religious and political views, violence, adult & sexual content.
- Other Ad-hoc and relevant projects as assigned.

**Qualifications**:
What should I bring with me?
- Bachelor’s degree or above, (major in journalism, literature, mathematics, computer, medical, law, economics)
- Excellent communication skills in English (both written and spoken), along with strong stakeholder management experience
- In-depth understanding of local culture and familiarity with the Internet usage habits of local users
- Possess quick-learning skills with the ability to understand existing and new business logic, metrics, and processes quickly
- Demonstrates critical thinking and creative problem-solving skills
- Experience in data analysis is preferred

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.



  • Singapore TikTok Full time

    Responsibilities TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa. TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai,...


  • Singapore TikTok Full time

    Responsibilities TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa. TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai,...


  • Singapore beBeeArtificial Full time

    Job Title: Visionary AI Model EvaluatorCompany Overview:About UsWe are a leading company specializing in Artificial Intelligence (AI), Large Language Models (LLM), and Computer Vision.Our cutting-edge technology is designed to help clients achieve their goals through innovative solutions.We offer a flexible working arrangement, allowing our team members to...


  • Singapore beBeeEvaluation Full time

    Job Title: Large Model Evaluation and Development ExpertWe are seeking a highly skilled Large Model Evaluation and Development Expert to join our AI team.This role involves designing and implementing evaluation frameworks and methodologies for large-scale models, ensuring they meet the highest quality standards. You will collaborate closely with AI...


  • Singapore PatSnap Full time

    About PatSnap Patsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable...


  • Singapore beBeeImpact Full time

    The role of an Impact Evaluation Specialist plays a pivotal part in assessing, enhancing and communicating the effectiveness of developmental programmes. Key Responsibilities: Develop and implement robust frameworks, tools and indicators to measure developmental outcomes across programmes using both qualitative and quantitative methods. Analyse and...


  • Singapore TikTok Full time

    Responsibilities TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa. TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai,...


  • Singapore NCS National Council of Social Service Full time

    **[What the role is]** We are a close-knit, high-performing, and multi-disciplinary research division in the Singapore Public Service. Our work includes longitudinal/panel and birth cohort studies, environmental scanning and sense making, evaluation at the sector, fund, and programme level, and economic evaluation. We operate in various areas ranging from...


  • Singapore Welo Data Full time

    Company Welo Data Designation English (Singapore) Digital Content Evaluation Specialist - App Store Date Listed 15 Jan 2025 Job Type Entry Level / Junior Executive - Free/Proj Job Period Flexible Start - Flexible End Profession IT / Information Technology Industry Artificial Intelligence / Smart Automation Location Name Singapore - Work from...


  • Singapore beBeeBimmodeller Full time $64,000 - $88,000

    Job Title: BIM Modelling Specialist">Job Description:We are seeking an experienced BIM Modelling Specialist to join our team. In this role, you will be responsible for creating and managing BIM content, extracting production documents, and ensuring the timely delivery of high-quality models.The ideal candidate will have a strong background in BIM modelling,...