Skip to content
aiqbench takeAI Research

aiqbench analysis

This newsletter highlights a METR study indicating that AI has significantly accelerated the discovery and reporting of cyber vulnerabilities, while its impact on mathematical research remains measurable only by increased output volume rather than definitive breakthroughs. The content also briefly touches on technical developments in environment generation (SPADE) and GPU kernel optimization (Hawkeye), though these serve as secondary updates within a broader analysis of AI's uneven progress across scientific domains.
Sources coveringImport AI, arXiv, organiser.org, Quantum Zeitgeist
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Import AI 470: No rights for machines; automating environment generation with SPADE; and building better GPU kernels with Hawkeye

Import AI22 min read

Welcome to Import AI, a newsletter about AI research. Import AI runs on arXiv, cappuccinos, and feedback from readers. If you’d like to support this, please subscribe. Subscribe now AI is accelerating some types of progress but not others:…A nice METR study lays out where acceleration is showing up…Here’s a little analysis from METR which […]

Welcome to Import AI, a newsletter about AI research. Import AI runs on arXiv, cappuccinos, and feedback from readers. If you’d like to support this, please subscribe. AI is accelerating some types of progress but not others:…A nice METR study lays out where acceleration is showing up…Here’s a little analysis from METR which looks at where AI may be accelerating different types of science and technology. The study looks at three different areas: cyber, math, and AI research, and finds that AI has contributed a lot to cyber, a little bit to math, and it’s hard to say for AI. Where have LLMs actually made a difference to scientific discovery? Cyber vulnerabilities: Major acceleration. “The rate of vulnerabilities reported across many projects has dramatically accelerated in 2026 compared with 2025, both for specific projects (cURL, OpenSSL, Firefox, and Microsoft) and for aggregate vulnerability databases (the US NVD, and OSV)”. Cyber vulnerabilities: Major acceleration. “The rate of vulnerabilities reported across many projects has dramatically accelerated in 2026 compared with 2025, both for specific projects (cURL, OpenSSL, Firefox, and Microsoft) and for aggregate vulnerability databases (the US NVD, and OSV)”. Mathematics research: Minor acceleration, but harder to measure. “AI is clearly contributing…

Excerpt shown under the publisher's RSS terms · 200 words · full text and figures are on the publisher's site

Related coverage