Sari la conținut

Română · beta. Traducerea a fost făcută automat și este încă în curs de revizuire. Citește pagina în engleză

perspectiva aiqbenchCercetare AI

analiza aiqbench

This is an AI research paper on personalizing LLM-based research ideation: a fine-tuned 8B model (TIGER-8B) is trained on individual researchers' preferences and compared against GPT-4.1. The reported win rates of 56.6% to 68.4% are modest and rest on a small number of judges and comparisons, so they show a directional preference signal rather than proof that tailored ideas are better. Readers should watch whether the work's evaluation extends beyond pairwise preference to idea novelty, feasibility, and downstream research outcomes.
Surse care acoperăarXiv, Latent Space, Quantum Zeitgeist, SiliconANGLE

TIGER: Learning from Researcher Taste to Generate Tailored Research Ideas

arXiv1 min de cititArticolul și perspectiva sunt în engleză.

arXiv:2611.02234v1 Announce Type: new Abstract: In pairwise comparisons where each judge chooses between an idea generated by its corresponding TIGER-8B policy and one generated by GPT-4.1, the three LLM researchers select the TIGER-8B idea in 56.6%-68.4% of 76 comparisons per researcher. PhD1 and PhD2 select the TIGER-8B idea in 19 of 30 pairs (63.3%) and 17 of 30 pairs (56.7%), respectively. All six directed cross-policy comparisons likewise favor the judge's matched TIGER-8B policy over an off-target policy, supporting the use of individual preference feedback for tailored research ideation.

Abstract:In pairwise comparisons where each judge chooses between an idea generated by its corresponding TIGER-8B policy and one generated by GPT-4.1, the three LLM researchers select the TIGER-8B idea in 56.6%-68.4% of 76 comparisons per researcher. PhD1 and PhD2 select the TIGER-8B idea in 19 of 30 pairs (63.3%) and 17 of 30 pairs (56.7%), respectively. All six directed cross-policy comparisons likewise favor the judge's matched TIGER-8B policy over an off-target policy, supporting the use of individual preference feedback for tailored research ideation.

Artificial Intelligence (cs.AI)

arXiv:2611.02234 [cs.AI]

(or arXiv:2611.02234v1 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2611.02234 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Text integral sub licența deschisă a publicației · 177 cuvinte

Subiecte conexe