Large Language Model Training Operations Specialist

2 weeks ago

Singapore beBeeDataScientist Full time $80,000 - $120,000

About us
We are a team focused on developing Large Language Models. Our mission is to create high-quality training data for these models, which will help them understand and generate human-like language.

  • Lead and manage multiple coding-focused LLM training projects, ensuring timelines, quality standards, and objectives are met. Track project progress, identify risks, and implement corrective actions as necessary to keep projects on course. Build and maintain strong relationships with product managers, researchers, data annotators, and other cross-functional team members. Communicate project updates, address concerns, and align expectations to ensure successful project outcomes.
  • Design, manage, and optimize workflows for coding-focused LLM training projects, including training design, QA processes, and performance tracking to meet project needs. Collaborate closely with product managers, project leaders and cross-functional teams to ensure alignment on quality metrics and project expectations.
  • Conduct quality and productivity improvement experiments to enhance operational processes for code-related training data. Lead and support general annotation operation improvement initiatives across various data domains. Develop and maintain technical guidelines and casebooks to support consistent, high-quality data production.
  • Design and implement robust data analysis strategies to evaluate training and evaluation datasets for LLM projects in the coding domain. Analyze annotation quality, model performance, and dataset coverage using statistical, visual, and programmatic methods. Identify data gaps, edge cases, and failure patterns by conducting slice-based evaluations, prompt sensitivity tests, and cluster-based error analysis. Utilize tools such as Python (Pandas, NumPy, Matplotlib) and SQL to generate actionable insights, monitor data pipeline health, and support model training operations. Collaborate with model trainers and researchers to inform training strategies and guide data-centric iterative improvements.
  • Provide mentorship and guidance to team members, helping to develop their skills and ensuring the delivery of high-quality outputs. Foster a collaborative environment where team members can share knowledge and best practices to improve overall performance.

Required Skills and Qualifications
Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience.
1-2 years of experience in project or operations management roles on software engineering teams.
1-2 years of experience with programming languages such as Python, Java, Go, or C, acquired through coding projects or technical roles.
Strong communication and problem-solving skills with the ability to understand and convey code-related concepts effectively.
Strong project management skills, with the ability to design, manage, and optimize complex workflows.

Benefits
A dynamic and collaborative work environment.
The opportunity to work on cutting-edge projects and contribute to the development of Large Language Models.
The chance to learn from experienced colleagues and develop your skills in data science and machine learning.

  • Expert in Large Language Models

    2 weeks ago

    Singapore beBeeArtificial Full time $120,000 - $180,000

    AI Training Data SpecialistWe are seeking a skilled AI training data specialist to play a pivotal role in managing the intricate processes involved in training large language models (LLMs) with diverse coding datasets.

  • Large Language Model Optimization Specialist

    1 week ago

    Singapore beBeeLanguagemodeloptimization Full time $150,000 - $200,000

    Job DescriptionWe are seeking a highly skilled engineer to develop and optimize large language models for reliable function calls and external tool usage.Key Responsibilities:Advanced post-training of large language models (e.g., SFT, RLHF/RLAIF, continual pretraining)Aligning models for reliable function calls and external tool usageDesign, deploy, and...

  • Large Language Model Deployment Engineer

    1 week ago

    Singapore SHANDA GROUP PTE. LTD. Full time

    **Main Responsibilities**: - Responsible for the deployment, maintenance, and updates of large-scale language models. - Monitoring and optimizing the deployment environment to ensure stable operation and high performance of the models. **Basic Requirements**: - Master's or doctoral degree in Computer Science, Artificial Intelligence, or a related field. -...

  • Large Language Model Evaluation Engineer

    1 week ago

    Singapore PATSNAP PTE. LTD Full time

    **About PatSnap** Patsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant,...

  • Software Engineer

    5 days ago

    Singapore ScienTec Consulting Full time

    **We are hiring for an innovate Software Engineer to develop a suite of productivity tools that can help with writing and coding, similar to the ChatGPT.** **You will work on Large Language Models (LLMs) development.** - Salary up to $11,500 + AWS - Work with a group of passionate and innovative colleagues - Hybrid working...

  • Visionary Large Vision-Language Model Specialist

    2 weeks ago

    Singapore beBeeMachineLearning Full time

    Large Vision-Language Generation Expert As a Large Vision-Language Generation Expert, you will be responsible for driving research and development on cutting-edge multimedia technologies. Key Responsibilities: Develop and improve algorithms for Large Vision-Language Generation Models. Explore new trends in the multimedia field, including multimodal...

  • Diversified Large Language Model Developer

    2 weeks ago

    Singapore beBeeAlgorithm Full time $80,000 - $120,000

    Job DescriptionWe are seeking a highly skilled Large Language Model Algorithm Engineer to join our team. The ideal candidate will have a strong background in computer science, artificial intelligence, or related fields, with experience in machine learning and deep learning.The successful candidate will be responsible for developing large model technologies...

  • Algorithm Engineer

    1 week ago

    Singapore ALPHA X TECHNOLOGY PTE. LTD. Full time

    Alpha X is an innovative high-tech manufacturing technology company pioneering the integration of advanced automation, transportation and AI-driven solutions to revolutionize traditional manufacturing processes. We harness the power of artificial intelligence, machine learning, and robotics to optimize production efficiency, enhance product quality, and...

  • Operation Team Lead

    1 week ago

    Singapore Outscal Technologies Full time

    About the job SummaryBy Outscal Lead a team of annotation specialists in training Large Language Models (LLMs). You'll manage daily operations, provide feedback, and accelerate professional growth. Experience in managing high-performing teams in a fast-paced environment is essential. - Responsibilities - About ByteDance Founded in 2012, ByteDance's mission...

  • Senior AI Engineer

    1 week ago

    Singapore beBeeAioops Full time $150,000 - $200,000

    Job DescriptionWe are seeking a skilled AIOps Machine Learning Engineer to join our team. As a key member, you will be responsible for developing and implementing cutting-edge technologies that enhance the functionality and user experience of our consumer products.In this role, you will work on exciting technologies for future Apple products and bring them...