
Ep. 176 | Cloudflare Just Drew a Line in the Sand Over AI Bots
Cloudflare announced in July 2026 that starting September 15, ad-supported websites on its free plan will block AI training crawlers and AI agent crawlers by default. Mixed-use crawlers — bots that declare both search and training purposes like Googlebot and BingBot — will be treated according to their most restrictive category, meaning blocking training may also block search indexing.
Michael and Frank break down what this means for small business owners who depend on websites for traffic and revenue. They explain Cloudflare's new three-category system — Search, Training, and Agent crawlers…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.