Skip to content
aiqbench takeMachine Learning

aiqbench analysis

Orchard addresses the critical bottleneck of proprietary infrastructure in agentic AI research by providing an open-source framework for scalable training and evaluation. By enabling smaller models to achieve performance comparable to frontier systems, it democratizes access to complex agent development across domains like software engineering and web navigation. This initiative directly advances the field of machine learning by removing barriers to reproducibility and fostering broader participation in autonomous system research.
Source coveringMicrosoft Research
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Orchard: An open framework for scalable agentic AI

Microsoft Research8 min read

Orchard is an open-source framework for the research community to train and evaluate AI agents across task types. It reduces complexity while supporting strong performance from smaller models by enabling researchers to reuse the same infrastructure. The post Orchard: An open framework for scalable agentic AI appeared first on Microsoft Research.

Orchard is an open-source framework for scalable and cost-effective agentic AI research, built around Orchard Env, a reusable environment service for training and evaluating agents across task domains. The same Orchard infrastructure supports software-engineering, web-navigation, and personal-assistant agents, and can train them directly inside real deployment harnesses such as Codex, OpenClaw, and ZeroClaw—letting researchers reuse environments, data pipelines, and evaluation workflows across tasks. Orchard-SWE, Orchard-GUI, and Orchard-Claw demonstrate that relatively small open-weight models can achieve strong results on complex real-world tasks. For example, Orchard-SWE reaches 69.7% on SWE-bench Verified—73.0% with value-model reranking—using only about 3 billion active parameters, approaching frontier systems using more than 10 times larger models. Alongside the models and workflows, the project releases training data and evaluation methods intended to help the broader research community build and study open agentic systems. Artificial intelligence is rapidly moving beyond static question-answering toward autonomous agents that can plan, reason, and act…

Excerpt shown under the publisher's RSS terms · 151 words · full text and figures are on the publisher's site

Related coverage