analiza aiqbench
The article describes Kiro, an AI coding agent, using an AI-driven workflow to model parts of its own harness in Lean 4 and prove properties about them. Of 96 candidate properties across 26 functions, Lean proved 70 and falsified 18, with the falsifications reproduced against the real code. The results are a single-vendor case study, so the practical value depends on how well the approach generalizes beyond Kiro's codebases.
Kiro proves properties of its own harness in Lean

We built an automated way for Kiro to model parts of its own code in Lean, prove theorems about those models, and check each model against TypeScript / Rust / Python code. We ran it first on Kiro itself. We analyzed 96 candidate properties and observations across models of 26 functions. Lean proved 70 of them, two received finite bounded checks, 18 were falsified in the model and reproduced against the analyzed code, and six produced partial results or observations. This is a demonstration of how Lean-driven verification workflows can be used in a real production setting to verify properties of the agentic harness and to catch hidden bugs.
We built an automated way for Kiro to model parts of its own code in Lean, prove theorems about those models, and check each model against TypeScript / Rust / Python code. We ran it first on Kiro itself. We analyzed 96 candidate properties and observations across models of 26 functions. Lean proved 70 of them, two received finite bounded checks, 18 were falsified in the model and reproduced against the analyzed code, and six produced partial results or observations. This is a demonstration of how Lean-driven verification workflows can be used in a real production setting to verify properties of the agentic harness and to catch hidden bugs. Our team works on context management for Kiro. The harness around the model decides what enters the context window and how much of it, compacts long conversations, keeps the start of each request stable for the prompt cache, and saves sessions so they can be restored. Around it sit the other harness primitives, e.g. tool calls and their approvals, streaming replies, sub-agents and background tasks. Bugs in this code are hard to catch with tests. They depend on inputs the model chooses, on the order of concurrent events, or on state…
Extras afișat conform termenilor RSS ai publicației · 200 cuvinte · textul integral și figurile sunt pe site-ul publicației
Subiecte conexe
Delivery, Not Storage: Cue-Anchored Working Memory as a Harness Property for Coding Agents
arXiv · 24 iul. 2026
Bounded Loops: Pre-Run Spend Bounds, Proved Termination, and Verified Completion for Agent Harnesses
arXiv · 24 sept. 2026
Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations
arXiv · 27 oct. 2026
IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier
arXiv · 11 sept. 2026