News
What happened
You can now distinguish and manage different types of AI traffic on your website with Cloudflare's latest update. This means you can protect your content more effectively and ensure fair compensation for its use.
Cloudflare has introduced new options for managing AI traffic, allowing you to classify and control Search, Agent, and Training bots. This update aims to give website owners like you finer control over how AI interacts with your content, addressing concerns about content usage without compensation. The changes come as a response to the evolving landscape of AI and its impact on web traffic, ensuring that you can protect your site while still being discoverable in search results.
Release at a glance
Key facts from the announcement.
Version
New AI traffic management options
Released
September 15, 2026
Platform
Cloudflare
REMOTE ACCESS
Protect Your Admin Sessions
A zero-exposure architecture secures your server. A VPN secures you — encrypting your connection when managing infrastructure from untrusted networks, coffee shops, or travel. NordVPN is what we use for this layer.
Try NordVPN →This is an affiliate link. If you purchase, I earn a commission at no extra cost to you.
Changes at a glance
What's new
You can now manage AI traffic with more granularity, distinguishing between Search, Agent, and Training bots. This allows you to tailor your site's interaction with AI traffic based on your specific needs and concerns.
The new classification system aims to provide clarity and control, enabling you to decide which types of bots can access your content and under what circumstances, enhancing your ability to protect your intellectual property.
Breaking changes
No breaking changes were reported in the source material.
Analysis
In detail
Cloudflare's new features allow you to manage AI traffic based on three classifications: Search, Agent, and Training. Each category represents different behaviors of bots visiting your site. Search bots collect and index your content, while Agent bots act on behalf of users in real-time, and Training bots absorb your content to improve AI models. This nuanced approach helps you better understand and control the access these bots have to your site.
Starting September 15, 2026, new domains onboarding to Cloudflare will have default settings that block Training and Agent bots on ad-displaying pages, while allowing Search bots. This change aims to protect your ad revenue while still enabling discoverability through search engines. The new options will be available to all customers, including those on the Free tier, giving you the flexibility to manage AI traffic according to your specific needs.
The update reflects a shift from a one-size-fits-all approach to a more tailored strategy that recognizes the diverse roles AI plays in web traffic today. By classifying bots based on their purpose, Cloudflare aims to enhance transparency and control for website owners like you.
Key takeaways
The most important facts from this update.
Why it matters
This update is crucial for your self-hosted setup as it allows you to protect your content while still being visible in search results. By managing AI traffic more effectively, you can ensure that your hard work is compensated appropriately.
Homelab impact
If you run a website on Cloudflare, these new options will significantly enhance your ability to manage how AI interacts with your content. You can now make informed decisions about which bots can access your site, helping to safeguard your content from unauthorized use while still benefiting from legitimate traffic.
As you prepare for the upcoming changes, consider reviewing your current settings and how they align with the new classifications. This proactive approach will help you maintain control over your content and ensure that your site remains competitive in an increasingly AI-driven landscape.
What to do next
Practical steps for operators running self-hosted stacks.
This brief covers what you need from Cloudflare Blog's reporting. Visit the original post for release notes, changelogs, and full technical documentation.