Cloudflare has publicly accused AI search company Perplexity of using stealth crawling techniques to bypass website restrictions such as robots.txt directives and network blocks. According to Cloudflare, Perplexity employs undeclared user agents, rotating IP addresses, and obscures its crawling identity to evade detection and access content from sites that explicitly block AI scraping. Cloudflare's August 4 blog post detailed that Perplexity repeatedly modifies its web-crawling bots to circumvent data-scraping defenses on millions of third-party websites. This has raised ethical and cybersecurity concerns within the technology community. Perplexity has responded by disputing Cloudflare's claims, arguing that the accusations are based on errors and misunderstandings, and clarifying that its AI assistant operates on real-time, user-driven requests rather than traditional web crawling. The dispute highlights ongoing tensions between AI companies and web infrastructure providers over data access and internet trust.
Perplexity vs Cloudflare: Are AI bots finding new ways to bypass a website’s defences? https://t.co/QNugHQTE49
Cloudflare’s recent allegations against Perplexity have sparked a debate about the wave of bots and AI agents flooding the internet, in particular, what sets them apart. #Perplexity #Cloudflare #AI #AIChatbots https://t.co/QNugHQTE49
An emerging phenomenon, dubbed AI psychosis or AI delusion, has users under the influence of delusional or false statements by chatbots that claim to be supernatural or sentient or discovering a new mathematical or scientific advance. https://t.co/0vnYCdg1D3 https://t.co/OOIvTZ4F4p