Large Language Model Evaluation Engineer

5 hours ago

Singapore PATSNAP PTE. LTD Full time

**About PatSnap**

Patsnap empowers IP and R&D teams by providing better answers, so they can make

faster decisions with more confidence. Founded in 2007, Patsnap is the global leader

in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our

extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers

actionable insights that increase productivity for IP tasks by 75% and reduce R&D

wastage by 25%. IP and R&D teams collaborate better with a user-friendly platform

across the entire innovation lifecycle. Over 15,000 companies trust Patsnap to

innovate faster with AI, including NASA, Tesla, PayPal, Sanofi, Dow Chemical, and

Wilson Sonsini.

**About the Role**

We are seeking a highly skilled and innovative Large Model Evaluation and

Development Engineer to join our cutting-edge AI team. In this role, you will be

responsible for designing and implementing evaluation frameworks and

methodologies for large-scale models, ensuring they meet the highest quality

standards. You will collaborate closely with AI researchers, data scientists, and

product managers to drive advancements in AI technologies. This position offers the

opportunity to work on groundbreaking projects that push the boundaries of AI and

machine learning.

**Key Responsibilities**:
- Design and implement comprehensive evaluation frameworks for large-scale AI models, including language models and vision models.
- Develop and maintain high-quality datasets for model evaluation and benchmarking.
- Collaborate with cross-functional teams to integrate evaluation results into the development cycle, providing actionable insights for model improvement.
- Develop tools and platforms for automated model evaluation and reporting.
- Stay updated with the latest research and trends in AI model evaluation and incorporate best practices into our processes.
- Improve the efficiency of the evaluation process, including data collection and annotation strategies.

**Desired Qualifications**:
- Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, or a related field.
- Proficiency in programming languages such as Python and database languages like SQL, familiarity with Linux operating systems, and strong programming skills.
- Experience with data manipulation and analysis using libraries such as NumPy and Pandas.
- Deep understanding of Bert and GPT-related principles, including key technologies like prompt, finetuning, and transformer.
- Familiarity with large model architectures and training processes.
- Strong insight into the development of large model technologies and the ability to learn and practice.
- Excellent problem-solving and communication skills, with the ability to work collaboratively in a team environment.

**Why Join Us**
- Work at the forefront of AI technology and participate in pioneering projects.
- Participate in the development of cutting-edge large model evaluation platforms.
- Opportunities for professional growth and continuous learning.
- Engage in regular team events and knowledge-sharing sessions.

  • Large Language Model Algorithm Engineer

    2 weeks ago

    Singapore Shopee Full time

    DepartmentEngineering and Technology- LevelExperienced (Individual Contributor)- LocationSingaporeThe Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies. Our engineers do not...

  • Large Language Model Architect

    7 days ago

    Singapore beBeeLanguage Full time $120,000 - $180,000

    Large Language Model EngineerAbout the RoleThis is a challenging opportunity for an experienced engineer to join our team in building and deploying large language models. The successful candidate will be responsible for designing, implementing and optimizing model architectures, as well as ensuring seamless integration into production environments.Key...

  • Algorithm Engineer

    23 hours ago

    Singapore ALPHA X TECHNOLOGY PTE. LTD. Full time

    Alpha X is an innovative high-tech manufacturing technology company pioneering the integration of advanced automation, transportation and AI-driven solutions to revolutionize traditional manufacturing processes. We harness the power of artificial intelligence, machine learning, and robotics to optimize production efficiency, enhance product quality, and...

  • Research Engineer I

    1 week ago

    Singapore Nanyang Technological University Full time

    A Corp Lab in NTU is looking for a Research Engineer I who will conduct cutting-edge research on large language models (LLMs) for Southeast Asian languages. Key Responsibilities: - Conduct research in the field of neural networks, natural language processing (NLP), and large language models (LLMs)- Critically evaluate existing literature and propose new...

  • Large Language Model Optimization Specialist

    20 hours ago

    Singapore beBeeLanguagemodeloptimization Full time $150,000 - $200,000

    Job DescriptionWe are seeking a highly skilled engineer to develop and optimize large language models for reliable function calls and external tool usage.Key Responsibilities:Advanced post-training of large language models (e.g., SFT, RLHF/RLAIF, continual pretraining)Aligning models for reliable function calls and external tool usageDesign, deploy, and...

  • Large Language Model Algorithm Engineer

    7 days ago

    Singapore beBeeAlgorithm Full time $80,000 - $120,000

    Job Title:Large Language Model Algorithm EngineerWe're seeking a skilled Large Language Model Algorithm Engineer to join our team. In this role, you will design and develop algorithms related to AI assistants, including but not limited to LLM post-training/SFT/MoE, user preference alignment with RL(such as DPO/GPRO).As a member of our team, you will be...

  • Algorithm Engineer, Large Language Model

    1 week ago

    Singapore Refine Group Full time

    The Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies. Our engineers do not merely solve problems at hand; We build foundations for a long-lasting future. We don't limit...

  • Large Language Model Algorithm Engineer

    2 weeks ago

    Singapore BYTEPLUS PTE. LTD. Full time

    Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. **Why Join...

  • Large Language Model Algorithm Engineer

    2 weeks ago

    Singapore ByteDance Full time

    Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join...

  • Large Language Model Fine-Tuner

    2 weeks ago

    Singapore beBeeArtificial Full time

    Job Title:A seasoned expert in artificial intelligence is sought after to spearhead large language model fine-tuning, leveraging user configuration data and software schema.Responsibilities:Fine-tune and adapt large language models for domain-specific configuration assistanceDesign, test, and optimize prompt strategies for varied scenarios, personas, and...