analiza aiqbench
This empirical study quantifies brand inclusion and recommendation dynamics across major LLMs, revealing high consistency in output shares but persistent competitive vacuums where specific brands are systematically omitted. The findings highlight that current large language models exhibit rigid co-mention structures that do not fully reflect real-world market diversity, offering critical insights for marketers and researchers analyzing AI-driven consumer behavior.
Who Owns the AI Recommendation? A Multi-Industry Empirical Map of Brand Category Ownership Across Large Language Models
arXiv:2606.23057v2 Announce Type: replace-cross Abstract: This exploratory study measures brand inclusion across five industries, 50 brands and 250 queries, each put five times to GPT-5.2, Gemini 3 Flash and Perplexity sonar-pro in February and September 2026 (3,614 and 3,750 scored answers). Category Inclusion Rate, Recommendation Share, Competitive Vacuum Index and Co-Mention Asymmetry have stated denominators. February inclusion rates sit close together across an industry's sampled brands (mean Gini 0.30), while at least one brand is named in 80% or more of answers to 204 of 250 queries. Vacuums occur in 7.6% of queries; provisional open-vocabulary model readings suggest most reflect the sampled brand list. The partially pre-specified September replication shows strong cross-date Recommendation Share correlation (Spearman 0.994), unchanged vacuum prevalence and agreement of 60.8% against February's 57.2%. The descriptive size association persists. Fixed margins do not account for all co-mention structure: 31 ordered pairs depart from the September null. Agreement exceeds the query-independent null, and both parametric-pair advantage intervals are positive. All ten clustering seeds yield zero emergent clusters. Matcher validation remains provisional pending author checks. The statistics describe system output and identify no causal mechanism.
Abstract:This exploratory study measures brand inclusion across five industries, 50 brands and 250 queries, each put five times to GPT-5.2, Gemini 3 Flash and Perplexity sonar-pro in February and September 2026 (3,614 and 3,750 scored answers). Category Inclusion Rate, Recommendation Share, Competitive Vacuum Index and Co-Mention Asymmetry have stated denominators. February inclusion rates sit close together across an industry's sampled brands (mean Gini 0.30), while at least one brand is named in 80% or more of answers to 204 of 250 queries. Vacuums occur in 7.6% of queries; provisional open-vocabulary model readings suggest most reflect the sampled brand list. The partially pre-specified September replication shows strong cross-date Recommendation Share correlation (Spearman 0.994), unchanged vacuum prevalence and agreement of 60.8% against February's 57.2%. The descriptive size association persists. Fixed margins do not account for all co-mention structure: 31 ordered pairs depart from the September null. Agreement exceeds the query-independent null, and both parametric-pair advantage intervals are positive. All ten clustering seeds yield zero emergent clusters. Matcher validation remains provisional pending author checks. The statistics describe system output and identify no causal mechanism.
Corrected February analysis and September 2026 replication; 30-page main paper and 31-page supplement. Matcher validation and open-vocabulary readings remain provisional pending human checks. Published data/code release: this https URL September derived outputs are not yet deposited
Information Retrieval (cs.IR); Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG)
H.3.3; J.4; K.4.4
arXiv:2606.23057 [cs.IR]
(or arXiv:2606.23057v2 [cs.IR] for this version)
Text integral sub licența deschisă a publicației · 242 cuvinte
Subiecte conexe

Presentation: Multi-Agent Patterns from Spotify’s AI Powered Advertising Platform
InfoQ · 8 oct. 2026

Vertical Advantage: Transforming Industries with Lakebase and Agentic AI
Databricks · 27 aug. 2026
CoreWeave’s next test: From GPU scarcity to a durable AI cloud
SiliconANGLE · 26 sept. 2026
Links #5: 2026/07
LessWrong · 31 iul. 2026