Cloudflare has introduced a Web Search API through its AI Gateway, aimed at solving a common problem with AI agents: when an agent needs live web information, it often has to guess a URL and attempt to fetch it directly, sometimes resulting in failed requests. The new API gives agents a way to actually search the web, similar to how a person would start with a search engine query.
Why it matters for AI applications
AI models are trained on data up to a fixed point in time, which makes it difficult for them to respond accurately to recent events, changing documentation, or fast-moving news. By integrating web search directly into an inference pipeline, developers can feed models fresh, structured snippets from the web as part of the request context, giving responses access to current information rather than relying solely on training data.
Launch partners and crawler standards
Cloudflare is launching the Web Search API with three partners: Ceramic.ai, Exa, and Linkup. Each has committed to meeting Cloudflare’s standards for verified bots, meaning their crawlers must comply with Cloudflare’s publicly documented requirements and web search responses must include a link back to the source of crawled content. Cloudflare frames this as part of a broader push for transparency, saying crawlers should identify themselves, respect robots.txt, and give site owners visibility and control over how their content is used in search results.
How developers can use it
The Web Search API is built into AI Gateway, which already provides observability, unified billing, security, and access controls for AI applications. Web search queries draw from the same AI Gateway credit balance, appear in standard observability logs, and can be access-controlled by provider. Cloudflare says it will identify which partners support Zero Data Retention so developers know when their data isn’t being retained, and that web search is offered at partner list API pricing with no added markup. Bring-Your-Own-Key support is also available for organizations with existing provider accounts.
Developers can reach the service two ways: a direct REST API for HTTP calls from any backend, mobile app, or external service, or a Workers Binding for those building on Cloudflare Workers, which Cloudflare says requires just a single line of code to add web search to an agent.
What’s next
Cloudflare says it is building native Server Tools directly into AI Gateway, with web search planned as one of the first tools included, so developers won’t need to manually define search as a tool in their own orchestration code. In the meantime, Cloudflare has provided example Worker code for developers who want to orchestrate web search as a server tool themselves today.