aiqbench takeAI Policy
aiqbench analysis
The page body is essentially empty, so this take rests on the title alone: it concerns how Perplexity's web crawling honors robots.txt, the standard that lets site owners control automated access. For AI readers, this bears on how AI search and answer engines source web content, and on the gap between a published crawler policy and what crawlers actually do. Verifying claims like this requires server logs and independent testing, not just a company statement.
2
Sources coveringPerplexity, The Verge
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.
How does Perplexity follow robots.txt?
Perplexity1 min read
How does Perplexity follow robots.txt? Perplexity
Read the full article at PerplexityRelated coverage

Chips & Infra
[AINews] Hot Chips: OpenAI’s Jalapeño, Cerebras CS-5, Groq 3 LPX, Apple M6
Latent Space · Aug 27, 2026
AI Products
[AINews] Modal’s $1B ARR, $16B Series D makes it NYC’s newest AI Infra Decacorn, 3x usage and 3x valuation in 5 months, 15x in 1 yr
Latent Space · Oct 15, 2026

AI Safety
[AINews] not much happened today
Latent Space · Sep 10, 2026

AI Products
[AINews] OpenAI to reach AGI bar by end-2026
Latent Space · Aug 28, 2026