Gen AI Quality Engineer
5 days ago
We are looking for a Gen AI Quality Engineer experienced in testing Large Language Models (LLMs). Gain exposure to cutting-edge Gen AI applications, including RAG chatbots and AI-driven classification systems. Work on next-generation AI quality initiatives with cross-functional product and AI research teams. Dynamic and fast-paced working environment. Responsibilities Design and execute comprehensive test cases and validation frameworks to assess the accuracy, reliability, and contextual correctness of LLM outputs. Detect and report hallucinations, fabricated responses, and inaccurate model behaviors across chatbot and classification systems. Develop automated test scripts and regression suites to identify inaccuracies and edge cases in LLM responses. Conduct functional and non-functional testing, including performance, load, and stress tests for LLM-powered applications. Document test plans, test cases, execution logs, and LLM-specific quality issues for audit and reference purposes. Collaborate closely with data scientists, AI researchers, and engineers to refine model quality and address identified issues. Perform regression testing after model updates, fine-tuning, or new data ingestion to ensure accuracy and prevent regressions. Requirements Tertiary education in Computer Science, Information Systems, Engineering or related field. Strong hands‐on experience testing Large Language Models such as GPT, BERT, or similar conversational AI models. Proficient in test automation using tools like Selenium, PyTest, or custom AI testing frameworks, with strong Python scripting skills. Solid understanding of AI/ML testing methodologies, including hallucination detection, NLP accuracy testing, and evaluation of context relevance. Experience reporting and tracking LLM-specific issues using Jira or similar platforms. Strong analytical and problem‐solving skills with the ability to work independently in a fast‐paced environment. By submitting your resume, you consent to the collection, use, and disclosure of your personal information per ScienTec's Privacy Policy (scientecconsulting.com/privacy-policy). This authorizes us to: Contact you about potential opportunities. Delete personal data as it is not required at this application stage. All applications will be processed with strict confidence. Only shortlisted candidates will be contacted. Lee Wen Ying (Mattias) - R ScienTec Consulting Pte Ltd - 11C5781#J-18808-Ljbffr
-
Gen AI Quality Test Engineer
1 week ago
Singapore SCIENTEC CONSULTING PTE. LTD. Full timeWorking Hours: Monday – Thursday (8.30am – 6pm), Friday (8.30am – 5.30pm) (Hybrid working arrangement)Working Location: Central Salary Package: Basic + AWS We are looking for a skilled and detail-oriented Gen AI Quality Engineer to join our team. In this role, you will be responsible for testing Large Language Models (LLMs) integrated into Gen AI...
-
Gen AI Engineer
1 week ago
Singapore INCOME INSURANCE LIMITED Full timeAnalytics Center of Excellence (COE) at Income Insurance is the enterprise team that champions and develops AI/ML solutions. We focus on in‐house solution development as well as partnerships. To ensure the successful execution of Income's enterprise strategy to build Analytics as a product through impactful AI/ML solutions, driving innovation, and...
-
Gen AI QA Engineer — LLM Testing
1 week ago
Singapore SCIENTEC CONSULTING PTE. LTD. Full timeA leading technology consulting firm in Singapore is seeking a skilled Gen AI Quality Engineer to test and validate Large Language Models (LLMs) integrated into applications. This role requires at least 4 years of QA experience, with a strong emphasis on detecting and resolving model inaccuracies. Collaborate with developers and AI researchers while...
-
Gen AI QA Engineer for LLM Testing
5 days ago
Singapore SCIENTEC CONSULTING PTE. LTD. Full timeA technology consulting firm is seeking a Gen AI Quality Engineer in Singapore. The role involves testing Large Language Models (LLMs) for accuracy and reliability, working with cross-functional teams to enhance AI applications. Applicants should have experience with testing frameworks and Python, along with a strong foundation in AI/ML methodologies....
-
Gen AI LLM QA
5 days ago
Singapore ScienTec Consulting Full timeA leading consulting firm in Singapore seeks a skilled Gen AI Quality Engineer to ensure the accuracy and reliability of LLMs integrated into AI applications. This role involves testing models for hallucinations, executing automated tests, and collaborating with AI teams. Ideal candidates will have strong skills in Python, test automation, and extensive...
-
Gen AI QA Engineer: LLM Testing
5 days ago
Singapore ScienTec Consulting Full timeA technology consulting firm in Singapore is seeking a Gen AI Quality Engineer experienced in testing Large Language Models. The role involves designing test cases, developing automated scripts, and collaborating with cross-functional teams in a fast-paced environment. Ideal candidates have strong experience with AI testing methodologies and proficiency in...
-
Developer - Generative AI (Gen AI)
5 days ago
Singapore ADOMITA TECHNOLOGIES PTE. LTD. Full timeKey Responsibilities Design, develop, and deploy Generative AI models and applications. Collaborate with cross-functional teams including data scientists, ML engineers, and product managers. Implement and fine-tune large language models (LLMs) and diffusion models for various use cases. Evaluate and optimize model performance, scalability, and reliability....
-
Developer - Generative AI (Gen AI)
4 hours ago
Singapore ADOMITA TECHNOLOGIES PTE. LTD. Full timeKey Responsibilities • Design, develop, and deploy Generative AI models and applications.• Collaborate with cross-functional teams including data scientists, ML engineers, and product managers.• Implement and fine-tune large language models (LLMs) and diffusion models for various use cases.• Evaluate and optimize model performance, scalability, and...
-
Gen Ai Lead
2 weeks ago
Singapore Capgemini Full timeChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of...
-
Gen AI Presales Consultant
1 week ago
Singapore REVUP PROSERVICES PTE. LTD. Full timeGen AI Presales Consultant Permanent role Work location: CBD area The Opportunity Partner with customers and prospects to understand business challenges and design GenAI-powered solutions that deliver measurable outcomes. Deliver high-impact technical demos, workshops, and POCs tailored to customer use cases (e.g., chatbots, RAG, embeddings, GenAI voice, and...