Llm Performance Operation, Specialist

1 week ago

Singapore ByteDance Full time

About ByteDance
Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join Us
Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us.

**About The Team**:
Join our LLM Global Data Team as a core member and be at the heart of our innovative operations. You'll gain invaluable experience in deciphering and enhancing the performance of LLMs across various metrics.

**Your Role Will Involve**:
1. Acquire hands-on experience in measuring the performance of LLM and related products, including the design and execution of tests.
2. Assist in the development of automated evaluation and testing processes.
3. Work closely with product managers and analysts, engaging with external experts and partners to bolster our performance analysis initiatives.

**Minimum Qualifications**:

- Strong command of English, with outstanding writing and analytical skills.
- Proficiency in critical thinking and establishing frameworks for performance assessment.
- Intelligent and meticulous individuals adept at content comparison and analysis within set frameworks.
- Ability to meet tight deadlines while maintaining a keen eye for detail.
- A profound interest in the world of Large Language Models (LLMs).

**Preferred Qualifications**:

- Prior experience in evaluating NLP models and search product performance is highly desirable.

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

  • Llm Performance Operation-specialist

    5 days ago

    Singapore BYTEDANCE PTE. LTD. Full time

    About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...

  • LLM Operations Specialist

    2 weeks ago

    Singapore TikTok Full time

    LLM Operations Specialist (Content Moderation)Responsibilities Join the forefront of AI innovation with cutting-edge advancements in AIGC and LLM technologies. As an LLM Operations Specialist, you will play a key role in leveraging AI for monetization, with a focus on content moderation. This position offers a unique opportunity to gain end-to-end expertise...

  • Llm Performance Operation, Analysts

    1 week ago

    Singapore BYTEDANCE PTE. LTD. Full time

    **Responsibilities**: About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...

  • Llm Performance Operation

    1 week ago

    Singapore BYTEDANCE PTE. LTD. Full time

    **Responsibilities** **About ByteDance** Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...

  • LLM Operations Specialist

    1 week ago

    Singapore TikTok Pte. Ltd. Full time

    Job Overview">TikTok's MissionTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy.About UsTikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.ResponsibilitiesModel Operations –...

  • Llm Global Data

    2 days ago

    Singapore ByteDance Full time

    Responsibilities About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...

  • LLM Operations Specialist

    2 weeks ago

    Singapore This is an IT support group Full time

    Responsibilities: Model Operations – Identify the most suitable model for specific tasks, troubleshoot performance issues or errors, and provide prompt feedback to model owners (algorithm engineers). Model/Policy Alignment – Ensure model outputs comply with organizational content policies and legal requirements through prompt engineering and other...

  • LLM Operations Specialist

    1 week ago

    Singapore TikTok Pte. Ltd. Full time

    Responsibilities: Model Operations – Identify the most suitable model for specific tasks, troubleshoot performance issues or errors, and provide prompt feedback to model owners (algorithm engineers). Model/policy Alignment – Ensure model outputs comply with organizational content policies and legal requirements through prompt engineering and other...

  • Seed - Llm Performance Operation Analyst (Non-safety)

    4 days ago

    Singapore ByteDance Full time

    Responsibilities About Doubao (Seed) Founded in 2023, the ByteDance Doubao (Seed) Team, is dedicated to pioneering advanced AI foundation models. Our goal is to lead in cutting-edge research and drive technological and societal advancements. With a strong commitment to AI, our research areas span deep learning, reinforcement learning, Language, Vision,...

  • LLM Model Optimization Expert

    1 week ago

    Singapore TikTok Pte. Ltd. Full time

    Job Summary:We are seeking an experienced AI Operations Specialist to join our team in Los Angeles or Singapore.Lead the development and implementation of LLM models for content moderation.Collaborate with algorithm engineers to deploy, monitor, and maintain LLMs in production.Ensure model efficiency in terms of cost, speed, and accuracy while ensuring...

  • Operation Team Lead

    1 week ago

    Singapore BYTEDANCE PTE. LTD. Full time

    **Responsibilities** **About ByteDance** Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...

  • Senior LLM R&D Specialist

    5 days ago

    Singapore TIKTOK PTE. LTD. Full time

    Job DescriptionWe are seeking an experienced Senior LLM R&D Specialist to join our Eng-AI Innovation Center and contribute to the development of cutting-edge AGI technologies, including large models for video/image/audio/text/code processing and automated orchestration. The ideal candidate will have expertise in distributed systems, deep learning frameworks,...

  • LLM Model Deployment Specialist

    4 days ago

    Singapore NetEase Games Full time

    As a pioneering internet technology company, NetEase Games develops and operates some of China's most popular mobile and PC games.Fueled by in-house R&D capabilities, we create superior gaming experiences, inspire players, and deliver value to our thriving community worldwide.We transform gaming into a meaningful vehicle to build a more entertaining and...

  • Llm/mlops Engineer, It

    1 week ago

    Singapore Singapore Technologies Engineering Ltd Full time

    Job ID: 16604- Location: Digital Hub, SG- Description: - **JOB RESPONSIBILITIES** **On-Premise Open-Source LLM Hosting and Deployment**: - Lead the deployment and management of open-source models like Llama, Mistral, and others in on-premise environments. - Design and implement infrastructure that supports large-scale LLM hosting, ensuring security,...

  • Llm Coding Trainer, Specialist

    1 week ago

    Singapore BYTEDANCE PTE. LTD. Full time

    About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...

  • Llm Red-teaming Operation, Analyst

    1 week ago

    Singapore ByteDance Full time

    About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...

  • Llm Red-teaming Operation

    5 days ago

    Singapore BYTEDANCE PTE. LTD. Full time

    About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...

  • AI Operations Specialist

    2 weeks ago

    Singapore TikTok Full time

    At TikTok, we're dedicated to inspiring creativity and bringing joy to our global community. As an LLM Operations Specialist, you'll play a pivotal role in harnessing the power of AI to drive significant business impact.Key ResponsibilitiesModel Operations: Identify suitable models for specific tasks, troubleshoot performance issues, and provide prompt...

  • Llm Training Operation

    1 week ago

    Singapore BYTEDANCE PTE. LTD. Full time

    About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...

  • Deep Learning Architect for LLMs

    4 days ago

    Singapore BRIGHTOIL PETROLEUM (S'PORE) PTE. LTD. Full time

    Job TitleDeep Learning Architect for LLMsBrightoil Petroleum (S'pore) Pte. Ltd. is seeking a highly skilled Deep Learning Architect for LLMs to design and develop cutting-edge NLP systems. As a key member of our AI/ML engineering team, you will be responsible for developing and deploying LLMs for various applications, working closely with cross-functional...