AI Product Management and Operation

3 weeks ago


Singapur, Singapore ByteDance Full time

Overview

AI Product Management and Operation (Evaluation) - Flow. Flow is ByteDance's AI-native innovation business team, focusing on developing products in emerging fields such as LLM. Our product portfolio includes Doubao (China) and Cici (Global). The Model Evaluation Team plays a key role within Flow, providing accurate and timely assessment signals for product iterations. We are responsible for the entire evaluation process, from designing methodology to executing evaluations, identifying issues, and proposing feasible improvement suggestions. Join us to explore innovative opportunities in AI, grow in a dynamic team environment, and create real value for users.

Responsibilities
  • Evaluation Framework Establishment: Design evaluation frameworks for the Cici App including standards, test cases, and workflows. Create metrics that measure performance across key dimensions and enable data-driven decisions in existing and upcoming use scenarios.
  • Human-Machine Evaluation Integration: Build workflows combining human expert and automated evaluation. Ensure automated processes align with human judgment, identify performance gaps, and increase testing coverage to supplement human evaluation.
  • Evaluation Results Analysis: Interpret and analyze evaluation findings with depth, transforming nuanced case analysis into actionable insights. Develop data production and product design strategies aimed at enhancing model capabilities and/or user experience.
  • Cross-functional Collaboration: Align product, engineering and evaluation teams across cultural and professional boundaries. Facilitate communication, resolve differences, and build consensus around overall evaluation methodologies.
  • Evaluation Methodology Research: Stay at the forefront of LLM evaluation by researching industry-leading assessment methodologies and reports. Integrate insights with practical applications to continuously improve our evaluation framework.
Qualifications

Minimum Qualifications

  • Bachelor's degree or above in Computer Science, Data Science, Business Analytics, or related fields
  • 3+ years of experience as a Product Manager, Business Analyst, or Operations Specialist in technology companies or other highly dynamic environment
  • Strong data analysis skills with experience in designing metrics for product performance
  • Project management capabilities with the ability to balance priorities and handle ambiguous requirements
  • Quick adaptation to new tools, technologies and concepts, with demonstrated learning agility
  • Genuine passion for AI/LLM technologies

Preferred Qualifications

  • Experience in AI/ML product management, particularly with conversational AI
  • Hands-on experience with LLM evaluation methodologies
  • Background in developing metrics frameworks for measuring product performance
  • Excellent stakeholder management and communication skills
About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day. As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Experience & Employment Details
  • Seniority level : Mid-Senior level
  • Employment type : Full-time
  • Job function : Product Management and Marketing
  • Industries : Technology, Information and Internet

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr
  • AI Product Manager

    3 weeks ago


    Singapur, Singapore Manus AI Full time

    Overview Direct message the job poster from Manus AI Conduct market research, user analysis, and competitive landscape analysis for the AI agent product to define a clear product positioning and growth strategy. Plan and manage the product roadmap, defining core objectives, feature priorities, and delivery timelines for each phase. Collaborate closely with...


  • Singapur, Singapore Manus AI Full time

    Overview Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Manus AI Responsibilities Scaling AI-powered monetization in a rapidly evolving landscape. You'll tackle the complex challenge of quantifying international market opportunities for AI products, developing data-driven audience segmentations that...

  • AI Product Manager

    3 weeks ago


    Singapur, Singapore Selby Jennings Full time

    Get AI-powered advice on this job and more exclusive features. This opportunity is with a leading hedge fund who is looking for a mission-driven Product Manager to lead the development of a global AI-powered investment assistant for retail investors. This product aims to simplify global stock investing and enable truly intelligent wealth management. You will...

  • Product Manager

    3 weeks ago


    Singapur, Singapore Thunes Full time

    Join to apply for the Product Manager - AI & Automation role at Thunes 1 day ago Be among the first 25 applicants Join to apply for the Product Manager - AI & Automation role at Thunes Thunes is the Smart Superhighway for money movement around the world. Thunes’ proprietary Direct Global Network allows Members to make payments in real-time in over 130...

  • Product Manager

    3 weeks ago


    Singapur, Singapore TikTok Full time

    Product Manager (Platform Operation) - AI Data Service And Operations Role overview and team context. The AI Data Service and Operations (ADSO) team provides safety and non-safety data annotation services and search operation services for TikTok's international products, helping build data ecological security for global products. As a Product Manager...


  • Singapur, Singapore PLAUD ai Full time

    About the role We're looking for a mature Product Leader with a forward-looking vision, system thinking mindset, and a strong belief in AI to build the next generation of AI-native office products from the ground up. This isn't your traditional "feature-stacking" product role. It's about fundamentally redefining how professionals in the AI era use tools,...


  • Singapur, Singapore HTX (Home Team Science & Technology Agency) Full time

    Join to apply for the Head (Product Management), AI Products role at HTX (Home Team Science & Technology Agency) Get AI-powered advice on this job and more exclusive features. What The Role Is The Home Team Science and Technology Agency (HTX) is a statutory board under the Ministry of Home Affairs (MHA) which aims to pioneer innovation solutions and...


  • Singapur, Singapore Home Team Science and Technology Agency (HTX) Full time

    Overview What the role is: The Home Team Science and Technology Agency (HTX) is a statutory board under the Ministry of Home Affairs (MHA) which aims to pioneer innovation solutions and develop world class science and technology capabilities to transform and empower the Home Team in delivering safety and security for Singapore. The HTxAI Products team is...


  • Singapur, Singapore HTX (Home Team Science & Technology Agency) Full time

    Overview The HTxAI Products team is committed to empower our Home Team Department (HTD)'s flagship projects through the seamless integration of AI technologies. From identifying opportunities to delivery, launch, and continuous enhancement, HTxAI aims to push boundaries and set new standards in homeland security. The Home Team Science and Technology Agency...


  • Singapur, Singapore PLAUD ai Full time

    ABOUT THE ROLE We seek an entrepreneurial and highly proactive Senior Product Manager to take ownership of the creation, development, and commercialization of our AI Products. This pivotal role provides a rare opportunity to join and build the founding team at our new Singapore office and closely collaborate with our team in Shenzhen. In this role, you will...