aiqbench analysis
Microsoft has open-sourced code-testing-generator, an autonomous agent that autonomously analyzes repository context to generate valid unit tests across multiple languages and frameworks. By executing a Research-Plan-Implement pipeline before writing code, it achieves significantly higher task completion rates than standard Copilot by resolving ambiguities in test framework selection and build commands locally. This tool directly addresses the "last mile" of software quality assurance where generic coding assistants often fail to produce runnable tests without specific human guidance.
Microsoft Open Sources code-testing-generator: a Polyglot Unit-Test Agent That Hits 92.1% Task Completion Versus 78.9% for Stock Copilot
Microsoft has open sourced code-testing-generator, a polyglot unit-test agent shipping in the MIT-licensed dotnet/skills repository. It reads a repository before writing anything — detecting the language, test framework, existing conventions, and the real build and test commands — then plans, writes, runs and validates the tests it produces. On Microsoft's internal 152-task benchmark it completed 140 tasks against 120 for stock GitHub Copilot on the same model, with the gain concentrated almost entirely in vague prompts and diff-targeted requests. The post Microsoft Open Sources code-testing-generator: a Polyglot Unit-Test Agent That Hits 92.1% Task Completion Versus 78.9% for Stock Copilot appeared first on MarkTechPost.
Microsoft has open sourced code-testing-generator, a polyglot agent that writes unit tests and then proves they work. It ships in the dotnet-test plugin inside the MIT-licensed dotnet/skills repository. The agent targets a gap that coding assistants usually leave open. A prompt like ‘generate unit tests’ does not say which framework, file location or assertions to use. code-testing-generator settles those decisions by reading the…
Excerpt shown under the publisher's RSS terms · 63 words · full text and figures are on the publisher's site
