analiza aiqbench
This paper introduces RAME, a training-free framework built on DeepSeek-V4-Flash that leverages retrieval augmentation and multi-prompt ensembling to dominate the Minor-Grain Breeding Information Extraction leaderboard. By aggregating diverse LLM outputs through majority voting, the system achieves an 11.4% relative improvement over the official GPT-5.5 baseline, demonstrating advanced techniques for extracting structured data from specialized scientific literature without additional model training.
Retrieval-Augmented Multi-Prompt Ensemble for Minor-Grain Breeding Information Extraction
arXiv:2609.07134v1 Announce Type: new Abstract: This paper presents our system for CCL2026-Eval Task 5: Minor-Grain Breeding Information Extraction (MGBIE), which jointly extracts 12 entity types and 6 relation types from minor-grain breeding literature. We propose RAME (Retrieval-Augmented Multi-Prompt Ensemble), a training-free framework that elicits multiple LLM outputs under controlled diversity and aggregates them by majority voting to obtain high-confidence predictions. RAME combines (i) retrieval-augmented few-shot selection via a hybrid BM25-embedding retriever, (ii) a three-prompt ensemble (Strict, Relaxed, Balanced) spanning the precision to recall spectrum, and (iii) large-scale repeated sampling with majority voting to filter noisy predictions. Built on DeepSeek-V4-Flash, RAME achieves a Total Score of 0.499 (NER 0.730, RE 0.346) on the leaderboard, ranking 1st and surpassing the official Track-A baseline powered by GPT-5.5 (0.448), representing an 11.4% relative improvement. Code is available at https://github.com/king-wang123/CCL26-RAME.
Abstract:This paper presents our system for CCL2026-Eval Task 5: Minor-Grain Breeding Information Extraction (MGBIE), which jointly extracts 12 entity types and 6 relation types from minor-grain breeding literature. We propose RAME (Retrieval-Augmented Multi-Prompt Ensemble), a training-free framework that elicits multiple LLM outputs under controlled diversity and aggregates them by majority voting to obtain high-confidence predictions. RAME combines (i) retrieval-augmented few-shot selection via a hybrid BM25-embedding retriever, (ii) a three-prompt ensemble (Strict, Relaxed, Balanced) spanning the precision to recall spectrum, and (iii) large-scale repeated sampling with majority voting to filter noisy predictions. Built on DeepSeek-V4-Flash, RAME achieves a Total Score of 0.499 (NER 0.730, RE 0.346) on the leaderboard, ranking 1st and surpassing the official Track-A baseline powered by GPT-5.5 (0.448), representing an 11.4% relative improvement. Code is available at this https URL.
Computation and Language (cs.CL)
arXiv:2609.07134 [cs.CL]
(or arXiv:2609.07134v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.07134 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Text integral sub licența deschisă a publicației · 227 cuvinte
Subiecte conexe
Fine-Grained Emotion Classification from Mobile App Reviews: An Empirical Study with Large Language Models
arXiv · 6 oct. 2026
MERGE: Multi-LLM Ensemble for Retrieval via Generative Enrichment
arXiv · 1 oct. 2026

How Fanatics Betting and Gaming built a multi-agent customer support system
AWS · 19 aug. 2026

AgentOps: Operationalize agentic AI at scale with Amazon Bedrock AgentCore
AWS · 1 iun. 2026