Skip to content
aiqbench takeAI Research

aiqbench analysis

This arXiv study analyzes what determines which web pages ChatGPT, Gemini, and Perplexity cite, using about 158,000 answers and 468,000 citations. Its main finding is that retrieval, meaning which pages the engine's own search returns for rewritten sub-queries, explains far more citation variation than page properties, and that the model's prior knowledge of brands also shapes both searches and rankings. For AI readers, it is a useful empirical look at how generative search pipelines work, and it suggests that GEO advice based on page tweaks may have limited leverage. The released data and code allow independent checking.
Sources coveringarXiv, Hugging Face
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

What Drives AI Citations? Content, Retrieval and Model Knowledge in Generative Engine Optimization (GEO)

arXiv3 min read

arXiv:2610.15033v1 Announce Type: cross Abstract: Generative search engines such as ChatGPT, Gemini and Perplexity now decide which Web pages users see as sources, and a growing industry of generative engine optimization advises publishers on how to earn these citations. We study what shapes citation in two 90-day collections of answers to commercial questions in contrasting markets: 158,099 answers with 468,037 citations. Comparing pages of the same website, content matters in one way: pages whose title and paragraphs match the questions people ask are cited more, whereas FAQ blocks, structured data, summary boxes and page speed appear effective only across websites. Page properties nevertheless explain little of the variation between pages of a website. Replaying the questions through the engines' APIs shows why. Every page ChatGPT cites is one its own search retrieved, and which pages that search retrieves, for sub-queries the model rewrites on every answer and that rarely coincide with Google's or Bing's results, explains far more of the variation than page properties (32% against 2.8%). Content acts mainly through this step, by matching the engine's queries in meaning. The model's own knowledge shapes it too: ChatGPT writes brands it knows into its searches, prefers websites it knows, and names brands without any supporting page, and controlled experiments show that brand names reorder its rankings of products with identical facts. Pages are thus cited when searched; brands are also named when remembered. The findings replicate in a market of small B2B vendors. We release data and code.

Title:What Drives AI Citations? Content, Retrieval and Model Knowledge in Generative Engine Optimization (GEO)

Abstract:Generative search engines such as ChatGPT, Gemini and Perplexity now decide which Web pages users see as sources, and a growing industry of generative engine optimization advises publishers on how to earn these citations. We study what shapes citation in two 90-day collections of answers to commercial questions in contrasting markets: 158,099 answers with 468,037 citations. Comparing pages of the same website, content matters in one way: pages whose title and paragraphs match the questions people ask are cited more, whereas FAQ blocks, structured data, summary boxes and page speed appear effective only across websites. Page properties nevertheless explain little of the variation between pages of a website. Replaying the questions through the engines' APIs shows why. Every page ChatGPT cites is one its own search retrieved, and which pages that search retrieves, for sub-queries the model rewrites on every answer and that rarely coincide with Google's or Bing's results, explains far more of the variation than page properties (32% against 2.8%). Content acts mainly through this step, by matching the engine's queries in meaning. The model's own knowledge shapes it too: ChatGPT writes brands it knows into its searches, prefers websites it knows, and names brands without any supporting page, and controlled experiments show that brand names reorder its rankings of products with identical facts. Pages are thus cited when searched; brands are also named when remembered. The findings replicate in a market of small B2B vendors. We release data and code.

Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

arXiv:2610.15033 [cs.IR]

(or arXiv:2610.15033v1 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2610.15033 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Full text under the publisher's open licence · 363 words

Related coverage