LLM Performance Operation, Analysts

2 weeks ago

Singapore BYTEDANCE PTE. LTD. Full time
Roles & Responsibilities

About ByteDance

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.


Why Join Us

Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us.


As a core member of our LLM Global Data Team, you'll be at the heart of our operations. Gain first-hand experience in understanding how to measure and analyze performance of LLM on various dimensions.


Your Role Will Involve:

1. Gaining direct experience in LLM and LLM-relevant product performance measurement, including creating metrics, designing and conducting tests, to help tech and product teams to understand LLM and product performance.

2. Delivering performance and feedback analysis to identify issues in LLM training and product design.

3. Collaborating with product managers and engineers to build testing workflows, create feedback loops, and enhance the effectiveness of testing processes and standards.

4. Working closely with the annotation team to gauge the quality of training data sets.

Qualifications

Minimum Qualifications:

1. Professional proficiency in English with excellent writing and critique skills.

2. Critical thinking and analytical skills are required.

3. Comfort with meeting deadlines and generating creative solutions, including the use of technology and tools, to enhance the quality of both individual and team outputs.


Preferred Qualifications:

1. Experience in consulting, market research, auditing, operational process design and improvement is valued. Experience as NLP model and search product performance evaluators is strongly preferred.

2. A deep interest in LLM is essential. The ideal candidate is an enthusiastic learner who finds engagement with diverse case studies stimulating.


Note:This role requires a paper test prior to interviews.


It is possible that this role will be exposed to harmful content as part of the core role/as part of project/by chance.

This may occur in the form of text, images, videos related to every-day life, but it can also include (but is not limited to) bullying; hate speech; child safety; depictions of harm to self and others, and harm to animals.


ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.


Tell employers what skills you have

Market Research
Microsoft Office
Microsoft Excel
Dashboard
Collaborating With Product Managers
Data Analysis
Product Design
Analytical Skills
Critical Thinking
Supply Chain
Auditing
Procurement
SAP
Accounting
Writing
Consulting

  • LLM Model Performance Operations Specialist

    4 weeks ago

    Singapore BYTEDANCE PTE. LTD. Full time

    LLM Model Performance Operations Specialist Job SummaryThis is a core member of our LLM Global Data Team, responsible for understanding and analyzing the performance of LLM on various dimensions. The ideal candidate has professional proficiency in English, critical thinking, and analytical skills, with a deep interest in LLM and a passion for...

  • LLM Training Operation

    2 weeks ago

    Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...

  • Operation team lead

    1 day ago

    Singapore This Is An IT Support Group Full time

    About Byte Dance Founded in 2012, Byte Dance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including Tik Tok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, Byte Dance has made it easier and more fun for people to connect with, consume, and...

  • AI Research Scientist

    4 weeks ago

    Singapore TikTok Full time

    About The TeamWe are a group of innovators working on cutting-edge AI technologies at TikTok's Eng-AI Innovation Center. Our mission is to explore the possibilities of Large Language Models (LLM) and their applications in various domains.Job DescriptionWe are seeking talented researchers to join our team in the development of LLM Agent platform. The ideal...

  • Research Scientist

    2 months ago

    Singapore NTU (Nanyang Technology University- Main Office-HR) Full time

    A Corp Lab in NTU is looking for a motivated Research Scientist to conduct cutting-edge research in the topic of "Green Cloud Computing", who will lead groundbreaking research in applying Large Language Models (LLMs) to enhance the design, operation, and optimization of data centers.Key Responsibilities:Lead and manage research focused on developing and...

  • LLM Coding Trainer, Specialist

    2 weeks ago

    Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...

  • LLM Coding Trainer

    2 weeks ago

    Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...

  • Senior LLM Engineer for Next-Generation AI

    4 days ago

    Singapore TikTok Full time

    About the RoleCompany OverviewTikTok is a leading social media platform that empowers users to create and share content. Our Eng-AI Innovation Center is dedicated to pushing the boundaries of Artificial General Intelligence (AGI) to enhance user experiences, improve content understanding, and defend against internet abuse.Job DescriptionWe are seeking a...

  • LLM Data Annotation Specialist

    2 weeks ago

    Singapore TikTok Full time

    About The TeamTikTok is dedicated to pushing the boundaries of AGI technologies, including LLM and multi-modal LLM. Our mission is to enable machines to better understand user creations on the TikTok platform, enhancing content understanding and user experience. We're seeking a highly skilled Data Annotation Expert to join our team and contribute to...

  • AI Research Scientist

    2 weeks ago

    Singapore TikTok Full time

    About the TeamThe TikTok Eng-AI Innovation Center is dedicated to pushing the boundaries of cutting-edge AGI technologies, including Large Language Models (LLMs) and multi-modal LLMs. Our mission is to improve the TikTok platform by enhancing content understanding and user experience through innovative machine learning solutions. The successful candidate...

  • LLM Architect

    2 weeks ago

    Singapore MARINE ONLINE (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesDescriptions: Design and optimize large language models, devise fine-tuning strategies, and streamline the training process. Explore deep learning architectures like Seq2Seq, Transformer, and advanced techniques including Fine-tuning, Prompt Engineering, and Soft Prompting (SFT). Develop systems for efficient model training and...

  • LLM Architect

    2 weeks ago

    Singapore UMILIFE (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesDescriptions: Design and optimize large language models, devise fine-tuning strategies, and streamline the training process. Explore deep learning architectures like Seq2Seq, Transformer, and advanced techniques including Fine-tuning, Prompt Engineering, and Soft Prompting (SFT). Develop systems for efficient model training and...

  • Research Scientist

    3 days ago

    Singapore NTU (Nanyang Technology University- MainOffice-HR) Full time

    A Corp Lab in NTU is looking for a motivated ResearchScientist to conduct cutting-edge research in the topic of "GreenCloud Computing", who will lead groundbreaking research in applyingLarge Language Models (LLMs) to enhance the design, operation, andoptimization of data centers.KeyResponsibilities:Lead andmanage research focused on developing and applying...

  • LLM Architect

    4 weeks ago

    Singapore BRIGHTOIL PETROLEUM (S'PORE) PTE. LTD. Full time

    Roles & ResponsibilitiesDescriptions: Design and optimize large language models, devise fine-tuning strategies, and streamline the training process. Explore deep learning architectures like Seq2Seq, Transformer, and advanced techniques including Fine-tuning, Prompt Engineering, and Soft Prompting (SFT). Develop systems for efficient model training and...

  • Tech Visionary for LLM-Driven Innovation

    2 weeks ago

    Singapore PST Full time

    At PST, we are seeking a Tech Visionary to spearhead our transformation towards a generative approach. As Deputy IT Lead for Development, you will provide leadership support and serve as a substitute for the Head of IT when necessary.About the RoleThis pivotal position involves leading the company's transformation, primarily through the integration of large...

  • Sales Operations Performance Analyst

    2 weeks ago

    Singapore Zebra Full time

    At Zebra, we extend the edge of possibility by shaping the future of work on the front line—reinventing how businesses run and moving society forward. We are a community of changemakers, innovators and doers who come together to deliver a performance edge to the front line of business. We develop new technologies and create new solutions with partners to...

  • Performance engineer

    3 weeks ago

    Singapore BARGHEST BUILDING PERFORMANCE PTE. LTD. Full time

    This role will report to the Performance Manager. Main Responsibilities Subject Matter Expert / Design & Solutions Conduct detailed performance analysis of HVAC systems to identify inefficiencies and areas for improvement. Develop and implement energy simulation techniques to evaluate system performance. Perform energy audits and assess compliance with...

  • Campaign performance analyst

    3 weeks ago

    Singapore Dow Jones & Company, Inc. Full time

    Dow Jones Campaign Performance Analyst in SINGAPORE, Singapore Job Description: As the Campaign Performance Analyst, you will be part of the WSJ Barron’s Group’s award-winning custom content team, The Trust. Based in the Singapore office, you will be responsible for executing custom content campaigns by tracking delivery, creating insightful performance...

  • Performance Analyst

    2 weeks ago

    Singapore KONE Full time

    KONE is seeking an experienced professional to optimize our Performance and Reward processes. As a Performance Analyst, you will streamline and automate processes using Excel or enabling technology, review Sales Incentive Plans, and develop conceptual frameworks for P&R analytics.Key Responsibilities:Review and optimize Performance and Reward...

  • Audit and Business Strategy Analyst Intern

    2 weeks ago

    Singapore OCBC Bank Full time

    Job OverviewThe Audit and Business Strategy Analyst Intern role at OCBC Bank presents an exciting opportunity to contribute to the development of cutting-edge audit analytics solutions.Key ResponsibilitiesConduct in-depth research on optimizing RAG systems for open-source large language models (LLMs).Analyze scalability issues in real-world applications and...