Gen AI Quality Engineer

5 days ago


Singapore ScienTec Consulting Full time

We are looking for a Gen AI Quality Engineer experienced in testing Large Language Models (LLMs). Gain exposure to cutting-edge Gen AI applications, including RAG chatbots and AI-driven classification systems. Work on next-generation AI quality initiatives with cross-functional product and AI research teams. Dynamic and fast-paced working environment. Responsibilities Design and execute comprehensive test cases and validation frameworks to assess the accuracy, reliability, and contextual correctness of LLM outputs. Detect and report hallucinations, fabricated responses, and inaccurate model behaviors across chatbot and classification systems. Develop automated test scripts and regression suites to identify inaccuracies and edge cases in LLM responses. Conduct functional and non-functional testing, including performance, load, and stress tests for LLM-powered applications. Document test plans, test cases, execution logs, and LLM-specific quality issues for audit and reference purposes. Collaborate closely with data scientists, AI researchers, and engineers to refine model quality and address identified issues. Perform regression testing after model updates, fine-tuning, or new data ingestion to ensure accuracy and prevent regressions. Requirements Tertiary education in Computer Science, Information Systems, Engineering or related field. Strong hands‐on experience testing Large Language Models such as GPT, BERT, or similar conversational AI models. Proficient in test automation using tools like Selenium, PyTest, or custom AI testing frameworks, with strong Python scripting skills. Solid understanding of AI/ML testing methodologies, including hallucination detection, NLP accuracy testing, and evaluation of context relevance. Experience reporting and tracking LLM-specific issues using Jira or similar platforms. Strong analytical and problem‐solving skills with the ability to work independently in a fast‐paced environment. By submitting your resume, you consent to the collection, use, and disclosure of your personal information per ScienTec's Privacy Policy (scientecconsulting.com/privacy-policy). This authorizes us to: Contact you about potential opportunities. Delete personal data as it is not required at this application stage. All applications will be processed with strict confidence. Only shortlisted candidates will be contacted. Lee Wen Ying (Mattias) - R ScienTec Consulting Pte Ltd - 11C5781#J-18808-Ljbffr



  • Singapore SCIENTEC CONSULTING PTE. LTD. Full time

    Working Hours: Monday – Thursday (8.30am – 6pm), Friday (8.30am – 5.30pm) (Hybrid working arrangement)Working Location: Central Salary Package: Basic + AWS We are looking for a skilled and detail-oriented Gen AI Quality Engineer to join our team. In this role, you will be responsible for testing Large Language Models (LLMs) integrated into Gen AI...

  • Gen AI Engineer

    1 week ago


    Singapore INCOME INSURANCE LIMITED Full time

    Analytics Center of Excellence (COE) at Income Insurance is the enterprise team that champions and develops AI/ML solutions. We focus on in‐house solution development as well as partnerships. To ensure the successful execution of Income's enterprise strategy to build Analytics as a product through impactful AI/ML solutions, driving innovation, and...


  • Singapore SCIENTEC CONSULTING PTE. LTD. Full time

    A leading technology consulting firm in Singapore is seeking a skilled Gen AI Quality Engineer to test and validate Large Language Models (LLMs) integrated into applications. This role requires at least 4 years of QA experience, with a strong emphasis on detecting and resolving model inaccuracies. Collaborate with developers and AI researchers while...


  • Singapore SCIENTEC CONSULTING PTE. LTD. Full time

    A technology consulting firm is seeking a Gen AI Quality Engineer in Singapore. The role involves testing Large Language Models (LLMs) for accuracy and reliability, working with cross-functional teams to enhance AI applications. Applicants should have experience with testing frameworks and Python, along with a strong foundation in AI/ML methodologies....

  • Gen AI LLM QA

    5 days ago


    Singapore ScienTec Consulting Full time

    A leading consulting firm in Singapore seeks a skilled Gen AI Quality Engineer to ensure the accuracy and reliability of LLMs integrated into AI applications. This role involves testing models for hallucinations, executing automated tests, and collaborating with AI teams. Ideal candidates will have strong skills in Python, test automation, and extensive...


  • Singapore ScienTec Consulting Full time

    A technology consulting firm in Singapore is seeking a Gen AI Quality Engineer experienced in testing Large Language Models. The role involves designing test cases, developing automated scripts, and collaborating with cross-functional teams in a fast-paced environment. Ideal candidates have strong experience with AI testing methodologies and proficiency in...


  • Singapore ADOMITA TECHNOLOGIES PTE. LTD. Full time

    Key Responsibilities Design, develop, and deploy Generative AI models and applications. Collaborate with cross-functional teams including data scientists, ML engineers, and product managers. Implement and fine-tune large language models (LLMs) and diffusion models for various use cases. Evaluate and optimize model performance, scalability, and reliability....


  • Singapore ADOMITA TECHNOLOGIES PTE. LTD. Full time

    Key Responsibilities • Design, develop, and deploy Generative AI models and applications.• Collaborate with cross-functional teams including data scientists, ML engineers, and product managers.• Implement and fine-tune large language models (LLMs) and diffusion models for various use cases.• Evaluate and optimize model performance, scalability, and...

  • Gen Ai Lead

    2 weeks ago


    Singapore Capgemini Full time

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of...


  • Singapore REVUP PROSERVICES PTE. LTD. Full time

    Gen AI Presales Consultant Permanent role Work location: CBD area The Opportunity Partner with customers and prospects to understand business challenges and design GenAI-powered solutions that deliver measurable outcomes. Deliver high-impact technical demos, workshops, and POCs tailored to customer use cases (e.g., chatbots, RAG, embeddings, GenAI voice, and...