Tag

web crawlers

All posts in this stream, newest first.

Cloudflare’s 16th Birthday Letter Warns of AI Agent Traffic Explosion

Cloudflare's 2026 founders' letter says automated traffic will overtake human traffic by May 2026 and outlines new tools meant to help small sites and creators survive the shift to agent driven browsing.

by Robbie·Sep 28, 2026·2 min read

Cloudflare Gives All Users Granular Controls Over AI Bot Traffic

Cloudflare is expanding its AI traffic management tools with three distinct categories, Search, Agent, and Training, available to all customers including those on the free tier.

by Robbie·Jun 21, 2026·2 min read