Human Centered AI

2 weeks ago

Singapore Apple Inc. Full time
Human Centered AI - Data Scientist - ASE

Singapore, Singapore Software and Services

Description

Our team is comprised of very talented individuals who are passionate about LLM and ensuring Apple services are at their best. As part of the Human-Centered AI team, you'll play a central role in enhancing the user experience.Responsibilities include:- Collaborate with Engineering, Products, Research, Operations, and Editorial teams to evaluate algorithms and AI models powering various features, identifying opportunities for improvement.- Build data products (feature datasets, analyses, models, etc.) and scalable tools (typically in Python or Scala) to drive hypothesis generation and support collaborative decision-making with our partner teams in engineering and product management.- Create structured evaluations to assess the quality of AI-generated responses, ensuring they align with company standards and customer expectations.- Create evaluation task design and guidelines; identify a relevant data annotation platform to run evaluations at scale.- Implement metrics to measure the effectiveness and accuracy of models to ensure they meet performance standards.- Establish data quality thresholds and reporting on metrics & insights to inform feature business decisions.- Monitor LLM performance in production environments through human evaluations, identifying trends, and raising alerts when quality degradation occurs.- Perform detailed failure analysis to understand model weaknesses and identify areas for improvement, offering actionable insights to engineers- Maintain high standards for data quality and continuously enhance processes based on both quantitative and qualitative feedback

Minimum Qualifications
  • Experience with machine learning concepts, including model evaluation metrics, and data analysis. Proven data analysis expertise using SQL, Python, and Tableau to deliver actionable insights
  • Experience with Large Language Models and evaluation techniques
  • Fluency in English reading, writing and comprehension skills to partner with international teams
  • Fluent in either Chinese, Japanese, Hindi, Korean, French, Spanish, to support the language specific market
  • Cultural understanding of one of the above mentioned language markets to accurately represent user experience in early development cycles
Preferred Qualifications
  • Ability to analyze complex issues, and identify potential problems with LLM outputs to improve quality with keen attention to detail
  • Effective collaboration with cross-functional teams to define ML/LLM evaluation requirements
  • Experience crafting, conducting, analyzing, and interpreting experiments and investigations
  • Flexibility to work early morning or late night shift patterns required
#J-18808-Ljbffr

  • Human Centered AI

    4 weeks ago

    Singapore APPLE SOUTH ASIA PTE. LTD. Full time

    Roles & ResponsibilitiesSummaryImagine what you could do here. At Apple, great new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish. Are you passionate about music, movies, and the world of Artificial Intelligence and...

  • Human Centered Ai

    2 weeks ago

    Singapore Apple Full time

    Imagine what you could do here. At Apple, great new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Bring passion and dedication to your job, and there's no telling what you could accomplish! Are you passionate about music, movies, and the world of Artificial Intelligence and Machine Learning? So are we!...

  • Human Centered Ai

    9 hours ago

    Singapore Apple Full time

    Imagine what you could do here. At Apple, great new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Bring passion and dedication to your job, and there's no telling what you could accomplish! Are you passionate about music, movies, and the world of Artificial Intelligence and Machine Learning? So are we!...

  • Director of Ux, Ai Products

    4 days ago

    Singapore PLAUD ai Full time

    **About the Role** We’re looking for a **Director of User Experience, AI Products** with a global mindset and a deep understanding of how AI is redefining the way people interact with digital products. As the design lead for our international product strategy, you’ll be responsible for shaping the user experience across all platforms—mobile, desktop,...

  • Data Center

    3 hours ago

    Singapore Super X AI Technology Limited Full time

    Overview Job Title: Data Center & GPU Engineer Location: Mapletree Business City @ Pasir Panjang Type: Full-time About Us SuperX AI is the leading infrastructure solutions provider for hyperscale data centers, building the next generation of AI factories. We are a full-stack provider supporting data center buildouts to AI servers, electric systems including...

  • Director of UX, AI Products

    2 weeks ago

    Singapore PLAUD ai Full time $150,000 - $200,000 per year

    About the RoleWe're looking for a Director of User Experience, AI Products with a global mindset and a deep understanding of how AI is redefining the way people interact with digital products.As the design lead for our international product strategy, you'll be responsible for shaping the user experience across all platforms—mobile, desktop, and web—...

  • Human Centered Change Consultant

    2 weeks ago

    Singapore Salesforce Full time

    **Job Category **:Customer Success Group **Job Details**: **Human Centered Change Consultant***: **Job Details**: The Salesforce Professional Services Human Centered Change team is a group of passionate consultants who create and execute change strategies through a human centered approach enabling our customers to maximize value from our Salesforce...

  • AI Researcher

    4 days ago

    Singapore beBeeArtificialIntelligence Full time

    We are seeking a seasoned researcher to contribute to the advancement of cutting-edge research in artificial intelligence applications for healthcare and human-centered computing. With extensive experience in medical image analysis, computer vision, and AI systems through collaborations with leading institutions. Conduct advanced research in the areas of...

  • Human-Centered Design Expert

    10 hours ago

    Singapore beBeeUXDesigner Full time $80,000 - $120,000

    Job DescriptionThe UX Designer is a key player in the development of critical enterprise solutions. They work closely with designers, software engineers, product managers, and other partners to understand requirements, distill user mindsets, employ creative techniques, and collaborate to execute projects efficiently.As a UX Designer, you will be part of a...

  • Tutoring Center Academic and Student Affairs Coordinator

    4 weeks ago

    Singapore Shanghai BSF Human Resources Co., Ltd Full time

    Tutoring Center Academic and Student Affairs Coordinator - Singapore Join to apply for the Tutoring Center Academic and Student Affairs Coordinator - Singapore role at Shanghai BSF Human Resources Co., Ltd Tutoring Center Academic and Student Affairs Coordinator - Singapore 1 day ago Be among the first 25 applicants Join to apply for the Tutoring Center...