Skip to content
aiqbench takeAI Products

aiqbench analysis

This study advances agent reliability by leveraging real-world failure data through a novel combination of rejection sampling and hint-guided self-distillation, directly addressing tool-call errors without discarding valuable negative examples. The approach demonstrates that correcting specific erroneous turns while preserving successful context can yield statistically significant improvements in live deployment scenarios. While the post-trained weights remain proprietary to Perplexity Computer, the methodology offers a concrete pathway for improving autonomous agent robustness using accessible base models like GLM 5.2.
Source coveringMarkTechPost
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Perplexity Trains Its Computer Agent on Real Mistakes With Hint-Guided Self-Distillation

MarkTechPost4 min read

Perplexity Research published a new post-training study. It trains a model inside Perplexity Computer on real user sessions, including failed ones. The method pairs rejection sampling fine-tuning with hint-guided self-distillation. In a live A/B test, tool-call failures fell from 2.24% to 1.77% between 2 trained checkpoints. Perplexity team reports this as a statistically significant 21.2% […] The post Perplexity Trains Its Computer Agent on Real Mistakes With Hint-Guided Self-Distillation appeared first on MarkTechPost.

Perplexity Research published a new post-training study. It trains a model inside Perplexity Computer on real user sessions, including failed ones. The method pairs rejection sampling fine-tuning with hint-guided self-distillation. In a live A/B test, tool-call failures fell from 2.24% to 1.77% between two trained checkpoints. The Perplexity team reports this as a statistically significant 21.2% relative reduction. Is it deployable? Not directly. Perplexity has not released the post-trained weights or training code. The model runs only as a…

Excerpt shown under the publisher's RSS terms · 79 words · full text and figures are on the publisher's site

Related coverage