Engineer / Lead Engineer (AI & Digital Solutions Certification), AI Central

Overview The Engineer / Lead Engineer of AI & Digital Solutions Certification will be a key member of a dynamic team responsible for developing, implementing, and maintaining a robust framework for evaluating AI systems. This role is critical in ensuring the safety, compliance, and ethical implementation of AI systems, whether developed internally or sourced from external vendors. The successful candidate will lead comprehensive testing and quality assurance processes, collaborating closely with cross-functional teams to identify technical requirements and refine the AI systems. They will play a pivotal role in establishing and enhancing AI quality and risk management processes, creating assessment frameworks, and developing evaluation methodologies. Responsibilities Design and implement comprehensive test plans to ensure the AI system-under-test satisfies the prevailing guidelines, framework, and specifications Conduct automated and/or manual tests to evaluate both discriminative and generative AI models used by the AI system-under-test to address identified AI risks Ensure the AI system-under-test adheres to government or regulatory standards and ethical considerations Contribute to establishing and refining AI quality and risk management processes, including creating assessment frameworks, checklists, and evaluation methodologies Document test results of the AI system-under-test and provide mitigation recommendations for the development cycle, fostering continuous improvement Collaborate with cross-functional teams, including AI developers, to identify technical requirements, pinpoint issues, and refine the AI system-under-test Stay abreast of new testing tools, approaches, and methodologies to enhance testing efficacy Establish and maintain a central repository of evaluated AI systems, including documentation and technical specifications Qualifications Postgraduate or Tertiary qualification in computer science, engineering, information systems or other quantitative/ analytical fields Good understanding of AI technology and concepts including prompt engineering, adversarial AI, machine learning, and deep learning Passionate interest in responsible AI and quality assurance in a fast-evolving domain, with a commitment to staying current with the latest developments Experience in software quality assurance management, with a proven track record of executing QA test activities such as test management, test automation, and penetration tests Demonstrated ability to work effectively with internal stakeholders to identify and refine technical requirements In-depth knowledge of AI quality and risk management practices and familiarity with AI-related standards (e.g. ISO/IEC, NIST) will be an advantage Familiarity with cloud-based AI platforms (e.g., AWS, Google Cloud, Azure), agile project and product management methodologies Experience or professional knowledge with the Home Team agencies or the homeland security industry is advantageous Applicants with more than 5 years’ relevant experience will be considered for more senior positions All new hires are appointed on a two-year contract in the first instance and will be assessed for permanent tenure over time, based on performance As part of the shortlisting process for this role, you may be required to complete a medical declaration and/or undergo further assessment All applicants will be updated on the status of their applications within 4 weeks upon closing of the advertisement About Home Team Science and Technology Agency (HTX)HTX is the world’s first Science and Technology agency that integrates a diverse range of scientific and engineering capabilities to innovate and deliver transformative and operationally-ready solutions for homeland security. As a statutory board of the Ministry of Home Affairs and integral to the Home Team, HTX works at the forefront of science and technology to empower Singapore’s frontline of security. Our shared mission is to amplify, augment and accelerate the Home Team’s advantage and secure Singapore as the safest place on planet earth. #J-18808-Ljbffr