AI Linguistic Quality Evaluator

4 days ago

singapore rws Full-time

We are looking for an AI Linguistic Quality Evaluator to assess how effectively an AI application performs in Malayalam for a long collaboration. This role is ideal for professionals with experience in linguistics, translation, interpretation, language teaching, writing, journalism, proofreading, content review, localization, or other language-focused fields.

The position is freelance and remote from Singapore, offering a flexible work schedule.

You will evaluate and audit multilingual AI-generated responses for accuracy, helpfulness, and cultural relevance, helping to shape the future of AI.

Pay: USD 24 per hour.

Responsibilities
  • Evaluate and audit multilingual AI-generated responses for accuracy, helpfulness, and cultural relevance.
  • Review assigned batches of AI outputs against localized quality guidelines.
  • Score responses and assign pass/fail ratings based on defined quality criteria.
  • Compare multiple AI-generated responses for the same prompt and rank them based on quality.
Qualifications
  • Native-level fluency in Malayalam.
  • Currently located in Singapore.
  • Advanced English proficiency to understand written instructions and guidelines.
  • Strong attention to detail and ability to evaluate content objectively.
  • Comfortable assessing content quality, accuracy, and cultural appropriateness.
  • Willingness to complete ID Verification.
  • Must pass the required Language Assessment.
  • Available to start immediately.
Preferred
  • Preferred: Experience in linguistics, translation, interpretation, language teaching, writing, journalism, proofreading, content review, or localization.