English Prompt evaluator

Get AI-powered advice on this job and more exclusive features.

Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine.

By combining advanced machine learning and artificial intelligence (ML/AI) technologies, a global workforce of subject matter experts, and a high-security infrastructure, we’re helping usher in the promise of AI. Innodata offers a powerful combination of both digital data solutions and easy-to-use, high-quality platforms.

Our global workforce includes over 5,000 employees in the United States, Canada, United Kingdom, the Philippines, India, Sri Lanka, Israel and Germany.

We are seeking highly skilled and culturally aware Red Teaming / Prompt Writers to join our AI Safety and Evaluation program. In this role, you will design, test, and refine prompts that challenge AI models on cultural relevance, sensitivity, and contextual accuracy . Your work will directly contribute to identifying cultural blind spots, potential biases, and region-specific issues in AI responses.

Job Title: AI Red Teaming & Prompt Evaluation Specialist

Hourly Commitment : 5-6 hours per day

This position is ideal for individuals with strong writing, research, and critical analysis skills, and a deep understanding of cultural norms, practices, and sensitivities across regions .

• Create diverse and challenging prompts to test AI models on cultural awareness, sensitivity, and adaptability.
• Develop scenarios that highlight cultural nuances, idiomatic expressions, traditions, festivals, rituals, and social issues.
• Red Teaming & Evaluation
• Simulate real-world user behaviour to surface failures in model responses.
• Identify cultural insensitivity, stereotyping, misrepresentation, or harmful outputs.
• Tag and classify violations (e.g., cultural inaccuracies, omission of key context, or safety triggers with cultural dimensions).
• Cultural Research & Documentation
• Conduct research on cultural practices, linguistic variations, and regional norms to inform prompt design.
• Maintain structured documentation of prompts, responses, and evaluation results for model improvement.
• Work with AI researchers, linguists, and safety experts to refine test cases.
• Provide clear, structured feedback and recommendations for mitigation strategies.

Required Qualification

• Proven experience in prompt writing, content evaluation, linguistics, or cultural studies .
• Strong knowledge of regional and cultural practices (one or more languages/regions preferred).
• Excellent writing skills with the ability to frame unbiased, clear, and context-rich prompts.
• Analytical mindset with the ability to detect subtle cultural inaccuracies or omissions.
• Comfort with structured evaluation frameworks and documentation.

Seniority level

• Seniority level Associate

Employment type

• Employment type Part-time

Job function

• Job function Analyst and Art/Creative
• Industries IT Services and IT Consulting

Referrals increase your chances of interviewing at Innodata Inc. by 2x

Get notified about new English Specialist jobs in Singapore .

Logistics Assistant (Mandarin & English Speaking) Bilingual Sales Development Representative (Japanese & English) Part-time Search Analyst Singapore (English language)

South West Community Development Council, Singapore 2 days ago

Chinese to English Game translators (Freelance/remote job) Principal Clinical Education Lead - Singapore or Hong Kong -APAC

Ang Mo Kio, North East Community Development Council, Singapore 1 week ago

North West Community Development Council, Singapore 1 week ago

South West Community Development Council, Singapore 1 week ago

South East Community Development Council, Singapore 1 week ago

Freelance Language Support Specialist (English to Chinese) Freelance Simplified Chinese to English AI Translation Reviewer - Materials Science and Chemistry

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

---