{"id":7961,"date":"2025-07-15T09:58:33","date_gmt":"2025-07-15T09:58:33","guid":{"rendered":"https:\/\/kocerroxy.com\/blog\/?p=7961"},"modified":"2025-07-15T09:58:34","modified_gmt":"2025-07-15T09:58:34","slug":"cloudflare-launches-auto-block-bots-for-websites","status":"publish","type":"post","link":"https:\/\/kocerroxy.com\/blog\/cloudflare-launches-auto-block-bots-for-websites\/","title":{"rendered":"Cloudflare Launches Auto Block Bots for Websites"},"content":{"rendered":"\n

AI companies aggressively crawl websites but rarely send traffic back in return. OpenAI’s crawl-to-referral ratio reached 1,700:1 by June 2025, while Anthropic showed an even more dramatic 73,000:1 ratio. These AI bots extract huge amounts of content and generate almost no return traffic to publishers. Cloudflare has tackled this problem by launching an automatic block bots feature that gives website owners better control over AI crawlers.<\/p>\n\n\n\n

Website owners who use Cloudflare can now automatically stop AI companies from collecting their digital data. This protection extends to nearly a quarter of all websites since Cloudflare manages about 20% of global internet traffic. The company has also rolled out Pay Per Crawl, which works smoothly with existing web systems and uses HTTP status codes to create a framework that charges for content access. This represents a radical alteration in how websites handle and monetize bot traffic, especially since Cloudflare’s CDN directly processes about 16% of global internet traffic.<\/p>\n\n\n\n

\n\n\n\n

<\/span>Cloudflare activates default AI bots blocking<\/span><\/h2>
\n
\n

Table of Contents<\/p>\nToggle<\/span><\/path><\/svg><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n