News
What happened
Cloudflare has launched the Attribution Business Insights dashboard, enabling you to analyze crawler behavior and differentiate between valuable and harmful bot traffic. This tool is essential for maintaining the integrity and profitability of your content.
The new Attribution Business Insights dashboard from Cloudflare provides you with critical insights into bot traffic on your website. As AI crawlers proliferate and disrupt traditional traffic models, this tool helps you assess which bots are beneficial and which are detrimental to your business. By offering detailed analytics on crawl-to-referral ratios and bot classifications, you can make informed decisions about managing access to your content and optimizing your revenue streams.
Release at a glance
Key facts from the announcement.
Product
Attribution Business Insights
Released
Available now
Platform
Cloudflare Bot Management
PRIVACY STACK
Extend Privacy Beyond DNS
Controlling your DNS queries is one layer of network privacy. Your email metadata — who you talk to, when, how often — is equally exposed with standard providers. Proton Mail applies end-to-end encryption to the layer most people ignore.
Try Proton Mail →This is an affiliate link. If you purchase, I earn a commission at no extra cost to you.
Changes at a glance
What's new
The Attribution Business Insights dashboard provides you with a comprehensive view of bot traffic, allowing you to differentiate between valuable and harmful crawlers. You can now access detailed analytics on crawl-to-referral ratios and the behavior of various bots, enabling you to make informed decisions about your content management strategy.
Breaking changes
No breaking changes were reported in the source material.
Analysis
In detail
The Attribution Business Insights dashboard is now available for all Cloudflare Bot Management customers. It offers a targeted view of bot traffic, allowing you to see the overall bot versus human traffic, the volume of bots accessing your content, and the crawl-to-referral ratios over various timeframes. This dashboard eliminates the need for extensive manual filtering, providing you with immediate access to key insights that matter most to your business.
You can analyze your site-wide crawl-to-referral ratio for 24 hours, seven days, or 30 days, and view detailed breakdowns of top bots by volume, including their origin and bandwidth usage. The dashboard also features an updated classification system for crawlers, categorizing them based on their behavior, such as Training, Search, or Agent, which helps you understand their impact on your content and traffic.
This launch comes at a time when the digital publishing industry faces challenges from the rise of AI crawlers, which often operate on an extractive scale. By utilizing the Attribution Business Insights dashboard, you can regain control over your content and make data-driven decisions regarding bot access and traffic management.
Key takeaways
The most important facts from this update.
Why it matters
Understanding bot traffic is crucial for maintaining the profitability of your website. The Attribution Business Insights dashboard equips you with the data needed to navigate the complexities of AI crawlers and optimize your content strategy.
Homelab impact
If you host your own website or content platform, the Attribution Business Insights dashboard can significantly enhance your ability to manage traffic. By leveraging the insights provided, you can identify which bots are beneficial for your business and which ones are merely consuming resources without providing value.
This tool allows you to adapt your content access policies based on real data, ensuring that you can maintain high-quality content while effectively managing the costs associated with hosting and serving that content. As AI crawlers continue to evolve, having this level of insight will be essential for sustaining your online presence and revenue.
What to do next
Practical steps for operators running self-hosted stacks.
This brief covers what you need from Cloudflare Blog's reporting. Visit the original post for release notes, changelogs, and full technical documentation.