Perplexity is using stealth, undeclared crawlers to evade no-crawl directives

Perplexity is using stealth, undeclared crawlers to evade no-crawl directives
953 by rrampage | 539 comments on Hacker News.