Patreon Blocks AI Training Bots After Scrapers Ignored Requests

Patreon has moved from asking AI companies not to scrape creator content to actively blocking their bots, partnering with internet infrastructure provider Cloudflare to enforce the restrictions.

The membership platform announced Thursday it's deploying Cloudflare's AI Crawl Control technology to prevent AI training bots from accessing creator work without permission. The shift represents an escalation from the company's 2023 approach, which relied on robots.txt files—a standard protocol that requests bots follow certain rules when accessing a site.

Why it matters

Patreon's experience reveals a fundamental problem with voluntary AI scraping guidelines: many AI companies simply ignore them. The platform's testing showed individual AI training crawlers made thousands of weekly access attempts despite explicit robots.txt instructions not to scrape. When active blocking was implemented, those attempts dropped to zero. This pattern suggests the current honor system for AI training data collection is failing, forcing platforms to adopt technical enforcement measures that were previously unnecessary for legitimate web crawlers.

The scraping problem intensified

Patreon said AI scraping has grown more sophisticated since it first implemented deterrent measures in 2023. While the platform's paywall has historically protected much creator content from crawlers, recent product launches created new exposure points. The company's redesigned Home Feed and its tweet-like feature called Quips made additional content potentially accessible to AI bots.

According to a company blog post, "Consent shouldn't depend on whether a scraper chooses to behave," explaining the rationale for mandatory blocking rather than voluntary compliance.

Selective access remains

Patreon isn't blocking all automated access. The platform will continue allowing bots that index pages and organize information designed to send users back to Patreon—traditional search engine crawlers that help with discovery rather than training AI models.

Drew Rowny, Patreon's product chief, framed the move as protecting creator rights in an AI-dominated landscape. "On most of the Internet, creators have to accept AI training on their work just to reach and grow an audience," Rowny said. "Patreon has a different vision: creators should be able to grow their audience and control how their work is used."

Broader industry shift

Patreon's enforcement approach aligns with emerging tools from Cloudflare, which now offers website publishers multiple options for restricting AI bots. These include a marketplace called Pay Per Crawl that lets websites charge AI companies for scraping access. Earlier in July, Cloudflare changed its policies to block "mixed-use" crawlers by default on ad-supported pages—bots that both index content and use it for AI training.

The details were first reported by TechCrunch.