analiza aiqbench
This paper introduces a conceptual framework to systematically characterize and analyze Retrieval-Augmented Generation (RAG) techniques, addressing the challenge of selecting optimal solutions before costly empirical benchmarking. By defining specific dimensions for evaluating RAG capabilities, it offers researchers and practitioners a pre-empirical filtering mechanism to better align technical choices with task requirements.
Characterising and Analysing Retrieval-Augmented Generation Techniques
arXiv:2610.23226v1 Announce Type: cross Abstract: The advent of Large Language Models (LLMs) across many application domains has increased the need for Retrieval-Augmented Generation (RAG) to reduce hallucinations and improve LLM performance. Thus far, several RAG techniques with impressive features and capabilities have been proposed in the literature, making it a herculean task to select the most appropriate RAG techniques for specific problem scenarios. Thus, we propose a conceptual framework comprising main dimensions and sub-dimensions for characterising (defining "what it is") and analysing (defining "how well it does") existing RAG techniques. The conceptual framework was developed through a qualitative analysis of the attributes of RAG techniques reported in the literature. It can serve as a pre-empirical filtering mechanism for researchers and practitioners in selecting the highest-fit RAG candidates that meet specific user and task requirements before empirical benchmarking of RAG techniques, which can be computationally and financially expensive.
Abstract:The advent of Large Language Models (LLMs) across many application domains has increased the need for Retrieval-Augmented Generation (RAG) to reduce hallucinations and improve LLM performance. Thus far, several RAG techniques with impressive features and capabilities have been proposed in the literature, making it a herculean task to select the most appropriate RAG techniques for specific problem scenarios. Thus, we propose a conceptual framework comprising main dimensions and sub-dimensions for characterising (defining "what it is") and analysing (defining "how well it does") existing RAG techniques. The conceptual framework was developed through a qualitative analysis of the attributes of RAG techniques reported in the literature. It can serve as a pre-empirical filtering mechanism for researchers and practitioners in selecting the highest-fit RAG candidates that meet specific user and task requirements before empirical benchmarking of RAG techniques, which can be computationally and financially expensive.
Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
arXiv:2610.23226 [cs.AI]
(or arXiv:2610.23226v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2610.23226 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Text integral sub licența deschisă a publicației · 239 cuvinte
Subiecte conexe
J++ Lens: Jacobian Filtering Enables More Faithful Workspace Lenses
LessWrong · 8 oct. 2026
Amazon is investing in the Lean Focused Research Organization
Amazon Science · 26 iul. 2026

34 Amazon Research Awards Build on Trainium recipients announced
Amazon Science · 5 aug. 2026

AI Transparency: Governance, Explainability, and Data Practices
Databricks · 20 iul. 2026