Being cited by AI models starts with a basic requirement: their bots need to be able to crawl your site in the first place. These two tabs give you both sides of that picture, what your robots.txt allows, and what's actually happening on your server.
Bots Access
Bots Access reads the robots.txt file of the domain configured in your project and shows you, at a glance, which AI crawlers are allowed in and which aren't.
Each bot falls into one of three statuses. Open means your robots.txt contains an explicit rule allowing that bot. Default allow means there's no rule mentioning that bot at all, so by default it's free to crawl your site. Blocked means your robots.txt explicitly disallows it.
Below the summary, you'll find the full list of AI bots checked against your rules, along with the type of bot (for example Training, Search, or Agent) and the platform it belongs to.
If you find a bot blocked that you'd rather have access to your content, update your robots.txt file and click Reload robots.txt to have Chatbeat pick up the change.
Bots Activity
While Bots Access tells you what's allowed, Bots Activity shows you what's actually happening, which AI bots are crawling your site and how. This is a more technical section aimed at teams who want to see real traffic data rather than just permission rules.
You can connect Chatbeat to your Cloudflare zone in read-only mode to pull AI crawler traffic data automatically, or upload your own server access logs (Apache CLF, Nginx, Caddy, JSON Lines, or a CSV export with timestamp and user-agent columns).
If your hosting or CDN provider isn't listed, reach out to us at [email protected] and we'll look into adding support for it.
To see which specific pages AI models are citing once they've crawled your site, check out our article on Top Citation Pages. If you have any questions, don't hesitate to contact us.



