aiqbench analysis
This system demonstrates the practical application of LLMs for structured information extraction in niche academic domains, specifically leveraging browser-based architecture to eliminate local infrastructure requirements. By utilizing schema-guided prompting with commercial APIs, it offers a scalable solution that balances high output compliance rates with privacy preservation and cost efficiency for researchers processing large volumes of literature.
TCMIIES: A Browser-Based LLM-Powered Intelligent Information Extraction System for Academic Literature
arXiv:2605.07507v2 Announce Type: replace Abstract: The rapid growth of academic publications has created a need for tools that extract structured knowledge from unstructured scientific texts. Although large language models (LLMs) can perform natural language understanding and information extraction, existing solutions often require specialized infrastructure, programming expertise, or fine-tuned domain-specific models, which limits their accessibility for researchers in specialized fields. This paper describes TCMIIES (Traditional Chinese Medicine Information Intelligent Extraction System), a browser-based, zero-installation platform that uses commercial LLM APIs to perform structured information extraction from academic literature. The system employs a schema-guided prompting framework with automatic system prompt generation, allowing researchers to define custom extraction schemas through a graphical interface without programming. TCMIIES features a pure front-end architecture that processes all information locally in the browser, supports five major LLM providers (DeepSeek, OpenAI, Qwen, Zhipu AI, and custom OpenAI-compatible endpoints), implements concurrent batch processing with automatic retry mechanisms, and provides intelligent field mapping for Chinese academic databases including CNKI and Wanfang. Evaluation across multiple extraction scenarios in Traditional Chinese Medicine research shows structured output compliance rates exceeding 94\% and extraction accuracy approaching but below expert-level agreement ($\kappa=0.82$ as reference). The system offers a flexible, privacy-preserving, and cost-effective solution for domain researchers who need to process literature at scale.
Abstract:The rapid growth of academic publications has created a need for tools that extract structured knowledge from unstructured scientific texts. Although large language models (LLMs) can perform natural language understanding and information extraction, existing solutions often require specialized infrastructure, programming expertise, or fine-tuned domain-specific models, which limits their accessibility for researchers in specialized fields. This paper describes TCMIIES (Traditional Chinese Medicine Information Intelligent Extraction System), a browser-based, zero-installation platform that uses commercial LLM APIs to perform structured information extraction from academic literature. The system employs a schema-guided prompting framework with automatic system prompt generation, allowing researchers to define custom extraction schemas through a graphical interface without programming. TCMIIES features a pure front-end architecture that processes all information locally in the browser, supports five major LLM providers (DeepSeek, OpenAI, Qwen, Zhipu AI, and custom OpenAI-compatible endpoints), implements concurrent batch processing with automatic retry mechanisms, and provides intelligent field mapping for Chinese academic databases including CNKI and Wanfang. Evaluation across multiple extraction scenarios in Traditional Chinese Medicine research shows structured output compliance rates exceeding 94\% and extraction accuracy approaching but below expert-level agreement ($\kappa=0.82$ as reference). The system offers a flexible, privacy-preserving, and cost-effective solution for domain researchers who need to process literature at scale.
Computation and Language (cs.CL); Information Retrieval (cs.IR)
arXiv:2605.07507 [cs.CL]
(or arXiv:2605.07507v2 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2605.07507 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 299 words
Related coverage

Scaling UX testing with Amazon Nova Act: A new approach to user flow analysis
AWS · Jul 14, 2026

Democratizing institutional knowledge: Building an AI-powered knowledge management system with AWS
AWS · Aug 24, 2026

News
Quantum Computing Report · Jul 25, 2026

Automated web insight extraction with Amazon Bedrock AgentCore
AWS · Aug 4, 2026