Sari la conținut

Română · beta. Traducerea a fost făcută automat și este încă în curs de revizuire. Citește pagina în engleză

perspectiva aiqbenchCercetare AI

analiza aiqbench

Snyk's vendor-run benchmark tests AI agents on 307 real dependency upgrades, scoring success only when the vulnerability is gone and the build and tests pass. Its most useful finding is that agents often claim fixes that rescans still flag, so verification matters more than the model's own report. Since Snyk built the benchmark and its own agent scored highest, readers should weigh the results with that in mind.
Sursă care acoperăSnyk Blog

VulnBump: Can AI Agents Fix Vulnerable Dependencies Without Breaking the Build?

Snyk Blog11 min de cititArticolul și perspectiva sunt în engleză.

VulnBump tests AI agents on 307 real dependency upgrades. A fix counts only if the vulnerability is gone and the build and tests stay green.

Can AI agents fix vulnerable dependencies without breaking the build? The fix itself is rarely the mystery. Over six months in 2026, Snyk Open Source recorded 459 million vulnerability findings across ~300,000 organizations. 94% of these vulnerabilities had a known fixed version, yet only about 10% had been resolved. That happens because the hard part is upgrading safely: most vulnerable packages are transitively imported, about a quarter of fixes require a major version bump, and even minor and patch releases, which are supposed to be backward compatible, often contain breaking changes. VulnBump, new research we published at Snyk, puts AI agents to the test on 307 real upgrades of vulnerable dependencies. An upgrade counts as a PASS only if the vulnerabilities are gone and the project still installs, builds, and passes its tests. What's new: to our knowledge, VulnBump is the first benchmark for AI agents built around security-driven upgrades: every task starts from real vulnerabilities that Snyk found in a real project, across six package managers. Earlier upgrade benchmarks check only for breakage, not whether the vulnerability is gone. So, can AI agents fix vulnerable dependencies without breaking the build? Mostly, yes, but the model alone doesn't decide it.…

Extras afișat conform termenilor RSS ai publicației · 200 cuvinte · textul integral și figurile sunt pe site-ul publicației

Subiecte conexe