AD/SM, AI Product Analyst

2 weeks ago

Singapore Government Technology Agency (GovTech) Full time

AD/SM, AI Product Analyst (AI Verify Foundation) page is loaded

AD/SM, AI Product Analyst (AI Verify Foundation)

Apply locations Singapore time type Full time posted on Posted Yesterday job requisition id JR-

(What the role is)

About Us:
AI Verify Foundation is an open-source initiative under the Infocomm Media Development Authority (IMDA), dedicated to advancing trustworthy AI. We develop and maintain open-source frameworks for evaluating LLM applications (Moonshot) and predictive ML models (AI Verify Toolkit). Our mission is to empower developers, data scientists, and organisations to build responsible, transparent, and reliable AI systems.
The Role:
We're looking for a Product Analyst to elevate the quality and relevance of our product offerings to our users. You'll bridge cutting-edge AI research with real-world evaluation needs, shaping our tools and frameworks for the success of our developer community. You will lead the quality assurance of the datasets, evaluators in our products, including contributions from our open-source community.

(What you will be working on)

Key Responsibilities:

  • Design and run offline A/B experiments to evaluate benchmark datasets and identify optimal evaluation methods for benchmark tests offered (including contributions from our open-source community) in Project Moonshot.
  • Educate and engage the developer community and Gen AI application deployers to build awareness of the challenges in benchmark testing, and champion the solutions provided in our library.
  • Research emerging GenAI evaluation techniques and open-source tools— translate key insights to inform product roadmap and turn research findings into actionable prototypes for engineering teams.

What We're Looking For:

  • Degree in Statistics or Economics, or a related technical field.
  • 3-5 years'experiences as data scientist, with strong grounding in statistics and experimental design and analysis.
  • Proficiency in Python/R is required. Experience in AI testing is a plus.
  • Deep intellectual capacity combined with a practical, user-centric mindset.
  • Excellent communication skills—able to simplify complex concepts for varied audiences.

(What we are looking for)

Only shortlisted applicants will be notified.

Position will commensurate with experience.

Similar Jobs (1)

Assistant Director, Tech Policy

locations Singapore time type Full time posted on Posted 30+ Days Ago #J-18808-Ljbffr

  • AD/SM, AI Product Analyst

    2 weeks ago

    Singapore IMDA Full time

    Join to apply for the AD/SM, AI Product Analyst (AI Verify Foundation) role at IMDA Overview About Us: AI Verify Foundation is an open-source initiative under the Infocomm Media Development Authority (IMDA), dedicated to advancing trustworthy AI. We develop and maintain open-source frameworks for evaluating LLM applications (Moonshot) and predictive ML...

  • AD/SM, AI Product Analyst

    4 days ago

    Singapore Government Technology Agency (GovTech) Full time

    AD/SM, AI Product Analyst (AI Verify Foundation) page is loaded AD/SM, AI Product Analyst (AI Verify Foundation) Apply locations Singapore time type Full time posted on Posted Yesterday job requisition id JR- (What the role is) About Us: AI Verify Foundation is an open-source initiative under the Infocomm Media Development Authority (IMDA), dedicated...

  • AD/SM, AI Product Analyst

    4 days ago

    Singapore IMDA Full time

    Join to apply for the AD/SM, AI Product Analyst (AI Verify Foundation)role at IMDA Overview About Us: AI Verify Foundation is an open-source initiative under the Infocomm Media Development Authority (IMDA), dedicated to advancing trustworthy AI. We develop and maintain open-source frameworks for evaluating LLM applications (Moonshot) and predictive ML...

  • Data Analyst

    2 weeks ago

    Singapore Manus AI Full time

    Overview Manus AI is hiring for a data-focused role. You will cooperate with business leaders, product managers and engineers to make Manus better. We are using data and smart decision tools to help building Manus and empower business. Business Intelligence: Analyze income, cost, growth metrics, and retention patterns to support strategic decisions Product...

  • Data Analyst

    4 days ago

    Singapore Manus AI Full time

    Overview Manus AI is hiring for a data-focused role. You will cooperate with business leaders, product managers and engineers to make Manus better. We are using data and smart decision tools to help building Manus and empower business. Business Intelligence: Analyze income, cost, growth metrics, and retention patterns to support strategic decisions Product...

  • AI Product Manager

    4 days ago

    Singapore Manus AI Full time

    Overview Direct message the job poster from Manus AI Conduct market research, user analysis, and competitive landscape analysis for the AI agent product to define a clear product positioning and growth strategy. Plan and manage the product roadmap, defining core objectives, feature priorities, and delivery timelines for each phase. Collaborate closely with...

  • Product -ai Product Manager

    7 days ago

    Singapore Manus AI Full time

    What You’ll Do - Product Strategy & Roadmap - Conduct market research, user analysis, and competitive landscape analysis for the AI agent product to define a clear product positioning and growth strategy. - Plan and manage the product roadmap, defining core objectives, feature priorities, and delivery timelines for each phase. - Collaborate closely with...

  • Data Analyst

    2 weeks ago

    Singapore PLAUD ai Full time $90,000 - $120,000 per year

    Job Description1、Own end-to-end user communication channels: EDM, Push Notifications, and more in the US market.2、Test and optimize comms and content strategy to boost user lifetime value.3、Build and manage automation, dynamic content, and personalized user journeys.4、Collaborate cross-functionally with growth, content, product, and design...

  • Product -AI Product Manager

    2 weeks ago

    Singapore Manus AI Full time $120,000 - $200,000 per year

    What You'll DoProduct Strategy & RoadmapConduct market research, user analysis, and competitive landscape analysis for the AI agent product to define a clear product positioning and growth strategy.Plan and manage the product roadmap, defining core objectives, feature priorities, and delivery timelines for each phase.Collaborate closely with management,...

  • Global Clinical Project Management SM/AD

    1 week ago

    Singapore Henlius Full time

    Global Clinical Project Management SM/AD Global Clinical Project Management SM/AD Shanghai, Beijing, and Singapore are all acceptable locations. Job Descriptions Ensure appropriate monitoring oversight plans are in place and reflect adequate adherence to all relevant regulations including GCP, ICH, local regulatory requirements, as well as SOPs and...