Cloudflare claims the AI startup is bypassing robots.txt restrictions to scrape content, potentially exposing Perplexity to lawsuits from publishers like Dow Jones and the BBC.

Web crawlers deployed by Perplexity to scrape websites are allegedly skirting restrictions, according to a new report from Cloudflare. Specifically, the report claims that the company's bots appear to be "stealth crawling" sites by disguising their identity to get around robots.

Perplexity could be in a tricky situation after being called out for accessing websites that don't want to be accessed by AI tools