MCP & Tools Python Developer - Agent Evaluation Infrastructure

2 days ago

Singapore Mindrift Full time

Overview At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. The Mindrift platform, launched and powered by Toloka, connects domain experts with cutting-edge AI projects from innovative tech clients. Our mission is to unlock the potential of GenAI by tapping into real-world expertise from across the globe. We are looking for hands-on Python engineers for a project focused on developing Model Context Protocol (MCP) servers and internal tools for running and evaluating agent behavior. You will implement base methods for agent action verification, integrate with internal and client infrastructures, and help fill tooling gaps across the team. Who we’re looking for Calling all security researchers, engineers, and penetration testers with a strong foundation in problem-solving, offensive security, and AI-related risk assessment. We value contributors with a hands-on approach to technical challenges, whether breaking into systems to expose weaknesses or building secure tools and processes. A passion for continuous learning, experimentation, and adaptability is highly regarded. Responsibilities Developing and maintaining MCP-compatible evaluation servers Implementing logic to check agent actions against scenario definitions Creating or extending tools that writers and QAs use to test agents Working closely with infrastructure engineers to ensure compatibility Occasionally helping with test writing or debug sessions when needed Although we’re only looking for experts for this current project, contributors with consistent high-quality submissions may receive an invitation for ongoing collaboration across future projects. Requirements 4+ years of Python development experience, ideally in backend or tools Solid experience building APIs, testing frameworks, or protocol-based interfaces Understanding of Docker, Linux CLI, and communication Ability to integrate new tools into existing infrastructures Familiarity with how LLM agents are prompted, executed, and evaluated Clear documentation and communication skills – you’ll work with QA and writers We also value applicants who have: Experience with Model Context Protocol (MCP) or similar structured agent-server interfaces Knowledge of FastAPI or similar async web frameworks Experience working with LLM logs, scoring functions, or sandbox environments Ability to support dev environments (devcontainers, CI configs, linters)JS experience Benefits Get paid for your expertise, with rates that can go up to $38/hour depending on your skills, experience, and project needs Take part in a flexible, remote, freelance project that fits around your primary professional or academic commitments Participate in an advanced AI project and gain valuable experience to enhance your portfolio Influence how future AI models understand and communicate in your field of expertise Employment details Seniority level: Mid-Senior level Employment type: Part-time Job function: Other Industries: IT Services and IT Consulting #J-18808-Ljbffr

  • Python Backend Engineer

    6 days ago

    Singapore TENSOR AI SINGAPORE PTE. LTD. Full time

    Responsibilities Architect backend MCP services to enable seamless context exchange between browsers and LLMs. Implement secure multi-tenant gateways with dynamic API key routing, request-level caching, and adaptive throughput control. Develop a unified tool invocation layer exposing JSON-RPC interfaces and integrating with Chromium extensions. Collaborate...

  • GenAI Developer

    4 days ago

    Singapore ST ENGINEERING IHQ PTE. LTD. Full time

    We’re looking for a hands-on GenAI Developer to design and productionize intelligent agentic systems powered by LLMs, computer vision, and vector databases. You’ll build autonomous agents that reason, retrieve, and act - driving real-world GenAI applications from prototype to production. This is a true builder role for someone who enjoys taking ideas...

  • AI Scientist

    9 hours ago

    Singapore DUOTECH PTE. LTD. Full time

    We are looking for highly skilled NLP & LLM Experts to join our AI team and drive innovation in Agentic AI systems , focusing on reasoning, memory management, tool use, and multi-agent orchestration. This role is ideal for individuals who are passionate about building intelligent systems that go beyond traditional LLM applications — leveraging LangGraph ,...

  • Senior Automation Engineer

    1 week ago

    Singapore Pfizer Full time

    Senior Automation Engineer - AMPS page is loaded## Senior Automation Engineer - AMPSlocations: Singapore - Tuastime type: Voltijdsposted on: Vandaag geplaatstjob requisition id: ## Pfizer Singapore is recruiting permanent employees for manufacturing site expansion of PFIZER ASIA MANUFACTURING PTE LTD (PAMPL) in Singapore.# # **Why Patients Need You**Whether...

  • Python Analytics Tools Developer

    1 week ago

    Singapore Luxoft Full time

    ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver: Scalable cost-efficient infrastructure, using cloud PaaS components. Single core platform, open architecture, designed for change, itemised $cost metrics, automated data lineage. Shared across Front Office, Finance and Risk, improving regulatory compliance. One-Platform /...

  • Quantitative Developer

    1 week ago

    Singapore WorldQuant Full time

    Overview Quantitative Developer - AI Implementation at WorldQuant. This role focuses on developing and maintaining components of an AI-driven platform that integrates Large Language Models (LLMs) with WorldQuant's strategy management tools to provide AI-assisted insights, automate routine analytical tasks, and enable natural language interactions for...

  • Senior Automation Engineer

    1 week ago

    Singapore Pfizer, S.A. de C.V Full time

    We’re in relentless pursuit of breakthroughs that change patients’ lives. We innovate every day to make the world a healthier place. To fully realize Pfizer’s purpose – Breakthroughs that change patients’ lives – we have established a clear set of expectations regarding “what” we need to achieve for patients and “how” we will go about...

  • Python Developer

    4 days ago

    Singapore Tribus Full time

    **Python Software Engineer - Quantitative Trading Systems** **(Relocation support available for experienced industry professionals)** **Locations**: Singapore | Hong Kong | Sydney **Employment Type**: Full-time, Permanent **Package**: Top-tier base + performance bonus + full benefits **About the Opportunity** A global trading firm is seeking a Python...

  • Principal AI Engineer

    1 day ago

    Singapore ST Engineering Group Full time $120,000 - $360,000 per year

    About the RoleWe're looking for a hands-on GenAI Developer to design and productionize intelligent agentic systems powered by LLMs, computer vision, and vector databases. You'll build autonomous agents that reason, retrieve, and act - driving real-world GenAI applications from prototype to production.This is a true builder role for someone who enjoys taking...

  • AI Agent Evaluation Analyst

    9 hours ago

    Singapore Mindrift Full time

    Get AI‐powered advice on this job and more exclusive features. Location & Application This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency. About Mindrift At Mindrift, innovation meets...