Llm Performance Operation

1 week ago

Singapore BYTEDANCE PTE. LTD. Full time

**Responsibilities**

**About ByteDance**

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

**Why Join Us**

Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us.

As a core member of our LLM Global Data Team, you'll be at the heart of our operations. Gain first-hand experience in understanding how to measure and analyze performance of LLM on various dimensions.

**Your Role Will Involve**:
1. Gaining direct experience in LLM and LLM-relevant product performance measurement, including creating metrics, designing and conducting tests, to help tech and product teams to understand LLM and product performance.

2. Delivering performance and feedback analysis to identify issues in LLM training and product design.

3. Collaborating with product managers and engineers to build testing workflows, create feedback loops, and enhance the effectiveness of testing processes and standards.

4. Working closely with the annotation team to gauge the quality of training data sets.

**Qualifications**:
2. Critical thinking and analytical skills are required. Experience in consulting, market research, auditing, operational process design and improvement is valued. Experience as NLP model and search product performance evaluators is strongly preferred.

3. Comfort with meeting deadlines and generating creative solutions, including the use of technology and tools, to enhance the quality of both individual and team outputs.

5. Note:This role requires a paper test prior to interviews.

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

  • Llm Performance Operation, Analysts

    1 week ago

    Singapore BYTEDANCE PTE. LTD. Full time

    **Responsibilities**: About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...

  • Llm Performance Operation-specialist

    5 days ago

    Singapore BYTEDANCE PTE. LTD. Full time

    About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...

  • Llm Performance Operation, Specialist

    1 week ago

    Singapore ByteDance Full time

    About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...

  • Llm Global Data

    2 days ago

    Singapore ByteDance Full time

    Responsibilities About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...

  • Seed - Llm Performance Operation Analyst (Non-safety)

    4 days ago

    Singapore ByteDance Full time

    Responsibilities About Doubao (Seed) Founded in 2023, the ByteDance Doubao (Seed) Team, is dedicated to pioneering advanced AI foundation models. Our goal is to lead in cutting-edge research and drive technological and societal advancements. With a strong commitment to AI, our research areas span deep learning, reinforcement learning, Language, Vision,...

  • LLM Operations Specialist

    1 week ago

    Singapore TikTok Pte. Ltd. Full time

    Job Overview">TikTok's MissionTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy.About UsTikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.ResponsibilitiesModel Operations –...

  • LLM Operations Specialist

    2 weeks ago

    Singapore TikTok Full time

    LLM Operations Specialist (Content Moderation)Responsibilities Join the forefront of AI innovation with cutting-edge advancements in AIGC and LLM technologies. As an LLM Operations Specialist, you will play a key role in leveraging AI for monetization, with a focus on content moderation. This position offers a unique opportunity to gain end-to-end expertise...

  • LLM Operations Specialist

    2 weeks ago

    Singapore This is an IT support group Full time

    Responsibilities: Model Operations – Identify the most suitable model for specific tasks, troubleshoot performance issues or errors, and provide prompt feedback to model owners (algorithm engineers). Model/Policy Alignment – Ensure model outputs comply with organizational content policies and legal requirements through prompt engineering and other...

  • LLM Operations Specialist

    1 week ago

    Singapore TikTok Pte. Ltd. Full time

    Responsibilities: Model Operations – Identify the most suitable model for specific tasks, troubleshoot performance issues or errors, and provide prompt feedback to model owners (algorithm engineers). Model/policy Alignment – Ensure model outputs comply with organizational content policies and legal requirements through prompt engineering and other...

  • Llm/mlops Engineer, It

    1 week ago

    Singapore Singapore Technologies Engineering Ltd Full time

    Job ID: 16604- Location: Digital Hub, SG- Description: - **JOB RESPONSIBILITIES** **On-Premise Open-Source LLM Hosting and Deployment**: - Lead the deployment and management of open-source models like Llama, Mistral, and others in on-premise environments. - Design and implement infrastructure that supports large-scale LLM hosting, ensuring security,...

  • Llm Red-teaming Operation, Analyst

    1 week ago

    Singapore ByteDance Full time

    About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...

  • Llm Red-teaming Operation

    5 days ago

    Singapore BYTEDANCE PTE. LTD. Full time

    About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...

  • Llm Training Operation

    1 week ago

    Singapore BYTEDANCE PTE. LTD. Full time

    About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...

  • Deep Learning Architect for LLMs

    4 days ago

    Singapore BRIGHTOIL PETROLEUM (S'PORE) PTE. LTD. Full time

    Job TitleDeep Learning Architect for LLMsBrightoil Petroleum (S'pore) Pte. Ltd. is seeking a highly skilled Deep Learning Architect for LLMs to design and develop cutting-edge NLP systems. As a key member of our AI/ML engineering team, you will be responsible for developing and deploying LLMs for various applications, working closely with cross-functional...

  • LLM Model Optimization Expert

    1 week ago

    Singapore TikTok Pte. Ltd. Full time

    Job Summary:We are seeking an experienced AI Operations Specialist to join our team in Los Angeles or Singapore.Lead the development and implementation of LLM models for content moderation.Collaborate with algorithm engineers to deploy, monitor, and maintain LLMs in production.Ensure model efficiency in terms of cost, speed, and accuracy while ensuring...

  • LLM Model Deployment Specialist

    4 days ago

    Singapore NetEase Games Full time

    As a pioneering internet technology company, NetEase Games develops and operates some of China's most popular mobile and PC games.Fueled by in-house R&D capabilities, we create superior gaming experiences, inspire players, and deliver value to our thriving community worldwide.We transform gaming into a meaningful vehicle to build a more entertaining and...

  • Research Engineer

    1 week ago

    Singapore Singapore-MIT Alliance for Research and Technology Full time

    **Project Overview**: We are hiring research engineers interested in advancing the state of the art in data-efficient machine learning at SMART in the new program: Mens, Manus and Machina: How AI empowers people and the city in Singapore (M3S). With the recent emergence of large language models (LLMs), the research engineers will assist in investigating how...

  • Llm Architect

    19 hours ago

    Singapore UMILIFE (SINGAPORE) PTE. LTD. Full time

    **Descriptions**: - Design and optimize large language models, devise fine-tuning strategies, and streamline the training process. - Explore deep learning architectures like Seq2Seq, Transformer, and advanced techniques including Fine-tuning, Prompt Engineering, and Soft Prompting (SFT). - Develop systems for efficient model training and deployment,...

  • LLM Global Data

    4 weeks ago

    Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilitiesAbout ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...

  • LLM Global Data

    4 days ago

    Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...