Current jobs related to Expertise in Large Model Evaluation and Development - Singapore - beBeeEvaluation

  • Model Evaluation Specialist

    1 week ago

    Singapore TikTok Full time

    Responsibilities TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa. TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai,...

  • Large Language Model Algorithm Engineer

    4 days ago

    Singapore Shopee Full time

    DepartmentEngineering and Technology- LevelExperienced (Individual Contributor)- LocationSingaporeThe Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies. Our engineers do not...

  • Optimizing Large Models

    4 days ago

    Singapore beBeeOptimization Full time

    Large Model Optimization EngineerWe are seeking a skilled Large Model Optimization Engineer to join our team. In this role, you will be responsible for developing and optimizing large models for inference and training.Your primary focus will be on designing and optimizing self-developed NPU software and hardware systems to achieve high-performance...

  • Expert Large Language Model Specialist

    1 week ago

    Singapore beBeeAlgorithm Full time $180,000 - $300,000

    Large Language Model EngineerJoin a company that specializes in large language models and apply for this role. Advanced post-training of large language models (e.g., SFT, RLHF/RLAIF, continual pretraining) is required. Aligning models for reliable JSON-schema function calls and external tool usage is essential. Design, deploy, and operate Model Context...

  • Visionary AI Model Evaluator

    5 days ago

    Singapore beBeeArtificial Full time

    Job Title: Visionary AI Model EvaluatorCompany Overview:About UsWe are a leading company specializing in Artificial Intelligence (AI), Large Language Models (LLM), and Computer Vision.Our cutting-edge technology is designed to help clients achieve their goals through innovative solutions.We offer a flexible working arrangement, allowing our team members to...

  • Large Language Model Fine-Tuner

    6 days ago

    Singapore beBeeArtificial Full time

    Job Title:A seasoned expert in artificial intelligence is sought after to spearhead large language model fine-tuning, leveraging user configuration data and software schema.Responsibilities:Fine-tune and adapt large language models for domain-specific configuration assistanceDesign, test, and optimize prompt strategies for varied scenarios, personas, and...

  • Model Evaluation Specialist

    1 week ago

    Singapore TikTok Full time

    Responsibilities TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa. TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai,...

  • AI Model Developer

    4 days ago

    Singapore beBeeDeveloper Full time $120,000 - $180,000

    Artificial Intelligence DeveloperWe are seeking a skilled AI developer to design, develop, and deploy advanced artificial intelligence models. The ideal candidate will have experience in designing, developing, and deploying AI applications, as well as leading automation initiatives.Key Responsibilities:Design and develop artificial intelligence models and...

  • Algorithm Engineer, Large Language Model

    2 days ago

    Singapore Refine Group Full time

    The Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies. Our engineers do not merely solve problems at hand; We build foundations for a long-lasting future. We don't limit...

  • Tiktok Shop

    2 weeks ago

    Singapore TikTok Full time

    Responsibilities About the team This role sits within the E-Commerce Governance and Experience team. This team is responsible for ensuring our marketplace is safe and trustworthy for not only users, but also sellers and creators. We value user experience and work on policies, rules, products and systems to ensure quality. We're looking for a Large Model...

Expertise in Large Model Evaluation and Development

3 weeks ago

Singapore beBeeEvaluation Full time
Job Title: Large Model Evaluation and Development Expert

We are seeking a highly skilled Large Model Evaluation and Development Expert to join our AI team.

This role involves designing and implementing evaluation frameworks and methodologies for large-scale models, ensuring they meet the highest quality standards. You will collaborate closely with AI researchers, data scientists, and product managers to drive advancements in AI technologies.

  • Key Responsibilities:
  • Design and implement comprehensive evaluation frameworks for large-scale AI models, including language models and vision models.
  • Develop and maintain high-quality datasets for model evaluation and benchmarking.
  • Create and apply metrics to assess model performance, robustness, and quality.
  • Collaborate with cross-functional teams to integrate evaluation results into the development cycle, providing actionable insights for model improvement.
  • Develop tools and platforms for automated model evaluation and reporting.
  • Stay updated with the latest research and trends in AI model evaluation and incorporate best practices into our processes.
  • Improve the efficiency of the evaluation process, including data collection and annotation strategies.

Required Skills and Qualifications:

  • Bachelor's or Master's degree in Computer Science, Artificial Intelligence, or a related field.
  • Proficiency in programming languages such as Python and database languages like SQL, familiarity with Linux operating systems, and strong programming skills.
  • Experience with data manipulation and analysis using libraries such as NumPy and Pandas.
  • In-depth understanding and application of common language or vision model evaluation metrics such as Cross-entropy, BPC/BPW, Perplexity, and ROUGE.
  • Deep understanding of Bert and GPT-related principles, including key technologies like prompt, finetuning, and transformer.
  • Familiarity with large model architectures and training processes.
  • Strong insight into the development of large model technologies and the ability to learn and practice.
  • Excellent problem-solving and communication skills, with the ability to work collaboratively in a team environment.

Benefits:

  • Work at the forefront of AI technology and participate in pioneering projects.
  • Participate in the development of cutting-edge large model evaluation platforms.
  • Opportunities for professional growth and continuous learning.
  • Engage in regular team events and knowledge-sharing sessions.