Engineer / Lead Engineer (AI & Digital Solutions Certification), AI Central

Join to apply for the
Engineer / Lead Engineer (AI & Digital Solutions Certification), AI Central
role at
HTX (Home Team Science & Technology Agency)
The Engineer / Lead Engineer of AI & Digital Solutions Certification will be a key member of a dynamic team responsible for developing, implementing, and maintaining a robust framework for evaluating AI systems. This role is critical in ensuring the safety, compliance, and ethical implementation of AI systems, whether developed internally or sourced from external vendors.
The successful candidate will lead comprehensive testing and quality assurance processes, collaborating closely with cross-functional teams to identify technical requirements and refine the AI systems. They will play a pivotal role in establishing and enhancing AI quality and risk management processes, creating assessment frameworks, and developing evaluation methodologies.
What You Will Be Working On
Design and implement comprehensive test plans to ensure the AI system-under-test satisfies the prevailing guidelines, framework, and specifications
Conduct automated and/or manual tests to evaluate both discriminative and generative AI models used by the AI system-under-test to address identified AI risks
Ensure the AI system-under-test adheres to government or regulatory standards and ethical considerations
Contribute to establishing and refining AI quality and risk management processes, including creating assessment frameworks, checklists, and evaluation methodologies
Document test results of the AI system-under-test and provide mitigation recommendations for the development cycle, fostering continuous improvement
Collaborate with cross-functional teams, including AI developers, to identify technical requirements, pinpoint issues, and refine the AI system-under-test
Stay abreast of new testing tools, approaches, and methodologies to enhance testing efficacy
Establish and maintain a central repository of evaluated AI systems, including documentation and technical specifications
What We Are Looking For
Postgraduate or tertiary qualification in computer science, engineering, information systems or other quantitative/analytical fields
Good understanding of AI technology and concepts including prompt engineering, adversarial AI, machine learning, and deep learning
Passionate interest in responsible AI and quality assurance in a fast-evolving domain, with a commitment to staying current with the latest developments
Experience in software quality assurance management, with a proven track record of executing QA test activities such as test management, test automation, and penetration tests
Demonstrated ability to work effectively with internal stakeholders to identify and refine technical requirements
In-depth knowledge of AI quality and risk management practices and familiarity with AI-related standards (e.g., ISO/IEC, NIST) will be an advantage
Familiarity with cloud-based AI platforms (e.g., AWS, Google Cloud, Azure), agile project and product management methodologies
Experience or professional knowledge with the Home Team agencies or the homeland security industry is advantageous
Applicants with more than 5 years’ relevant experience will be considered for more senior positions
All new hires are appointed on a two-year contract in the first instance and will be assessed and considered for permanent tenure over time, based on performance. As part of the shortlisting process for this role, you may be required to complete a medical declaration and/or undergo further assessment. All applicants will be updated on the status of their applications within 4 weeks upon closing of the advertisement.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Government Administration
#J-18808-Ljbffr