Cloudflare marked its 16th birthday this week with an annual founders’ letter that lays out a stark forecast: automated traffic (bots, crawlers, and AI agents) is on pace to overtake human traffic on the Internet by May 2026, years earlier than the company’s earlier prediction of late 2027. Cloudflare says that if current trends hold, automated traffic could reach 1,000 times human traffic within five years, driven mainly by exploding agent activity rather than any decline in human use.
The letter also points to a notable reversal in web growth. After years of a roughly flat or shrinking web from 2012 through 2025, Cloudflare says mid-2025 brought a sharp increase in new websites. The company attributes much of that growth not to AI generated “slop” but to a new wave of non-technical creators using “vibe coding” tools to build and deploy projects, many of them landing on Cloudflare’s developer platform, which now reportedly serves more than 7 million developers.
The Agent Economy Problem
Cloudflare frames AI agents as both a benefit and a risk for site owners. Agents can research and compare options far faster than a human, but that convenience comes at a cost: a single agent request might scan hundreds of restaurant menus or business listings to recommend just one, leaving every other site to absorb crawl traffic without any return. Cloudflare describes this as a tragedy of the commons, where the businesses benefiting from agent driven traffic don’t bear the load costs those agents create.
There’s also a competitive concern. Cloudflare warns that agents tend to favor whichever business has the most existing information available, typically the longest established players, rather than weighing the intangible factors (service, familiarity, convenience) that help small and new businesses win customers today. Left unchecked, the company argues, this dynamic could make it harder for new entrants to break in and could accelerate market consolidation.
What Cloudflare Is Changing
To address the load problem, Cloudflare says it’s working on crawler infrastructure that lets agents fetch only content that has changed since their last visit, rather than re-crawling entire sites repeatedly. The company notes that more than half of what bots currently fetch hasn’t changed since the previous visit, meaning a meaningful share of crawl traffic is redundant.
Cloudflare also says it plans to introduce a way for site owners, whether publishers, developers, or businesses, to get paid when AI agents use content or applications they’ve built, and it plans to announce partnerships with other companies working toward similar goals.
For WordPress site owners and hosting operators, the letter signals that bot and crawler management, and eventually compensation mechanisms for AI usage, are likely to become more central to how sites are configured and monetized in the near future.