aiqbench analysis
This article details how a Neo4j-based semantic layer significantly reduces token consumption and improves accuracy for Text2SQL agents operating over large, heterogeneous data catalogs. By grounding AI agents in business context rather than forcing them to guess schema relationships, the approach lowers operational costs while ensuring reliable query execution across major cloud platforms.
Cut Text2SQL token costs up to 81%, and stop paying for wrong answers: a Neo4j semantic layer across BigQuery and Databricks

Across two deliberately hostile catalogs (278 Census tables on BigQuery and 264 legacy tables on Databricks), a Neocarta semantic layer in Neo4j makes Text2SQL agents faster, cheaper, and more accurate. On Census it cut tokens up to 81% while lifting… Read more →
Across two deliberately hostile catalogs (278 Census tables on BigQuery and 264 legacy tables on Databricks), a Neocarta semantic layer in Neo4j makes Text2SQL agents faster, cheaper, and more accurate. On Census it cut tokens up to 81% while lifting a cheap model from 2/4 to 4/4; on Databricks flagships it saved up to 54% (roughly $1,527 → $693 per month at 10K queries on Opus 4.5 as of August 2026), with every model at 11/11. And without the layer, that same cheap model burned 66,687 tokens and still gave up with no answer. A semantic layer sits between your data and whatever consumes it (a BI tool, or now an AI agent) and turns opaque physical schema into business meaning. And its inputs aren’t only databases: it harvests metadata from warehouses and lakes, data catalogs, query logs (real join paths and usage), and business glossaries or ontologies. Point an agent straight at raw tables and it re-derives your joins, definitions, and table choices on every prompt, guessing which of a dozen “revenue” tables is the real one. The semantic layer is what removes the guessing. A semantic layer sits over many sources (warehouses, catalogs, query logs, and glossaries), not…
Excerpt shown under the publisher's RSS terms · 200 words · full text and figures are on the publisher's site
Related coverage
DI Series: Serving Kimi-K3 MXFP4 Wide-EP Disaggregated on AMD Instinct MI300X and MI325X
AMD · Oct 8, 2026

Can Cloudflare CEO Matthew Prince save the web from AI?
The Verge · Sep 26, 2026

Presentation: You Can't Trust Your AI Bill. And Neither Can I
InfoQ · Oct 12, 2026

Humanity’s Last Invention — Richard Socher of Recursive
Latent Space · Sep 14, 2026