AI Traffic
Cloudflare AI Crawl Control
Analyze AI crawler requests and manage how AI services access your website.
What it does
- Inspect AI crawler activity and request patterns on domains using Cloudflare.
- Manage crawler access and review robots.txt behavior; free-plan metrics cover the past 24 hours.
Who it is for
Website operators and publishers measuring AI crawler access to their content.
Platforms & scope
See the official product documentation for current coverage.
Sources & verification
Last checked:
Checked against official product information. This is a source review, not a hands-on test. Features and plans may change.