Docs · Autopilot · AI crawler analytics
AI crawler analytics
Which AI bots read your site, which pages they read, and what they find.
What you see
Visits from 19 AI bots grouped by company and purpose (training, AI search index, live answer fetch, agent), the pages they read and the ones no bot has visited, live answer fetches, errors served to bots, and what your robots.txt allows each bot to do. Available from Growth up.
Setup
Connect a source from AI crawlers, Setup. Only an IP prefix is stored, never a full IP address.
// Was this helpful?
Your feedback goes to the docs team. No reply unless you paste an email.
docs/ai-crawlers.md · last edited Oct 8, 2026Email feedback ↗