AI Crawler Tracking
See which AI crawlers visit your site and the pages they access.
Track AI crawler activity
Faurya can now track supported AI, indexing, and training crawlers that visit your website.
Install the crawler package in your middleware to see which bots accessed your site, the pages they visited, and when the crawl happened.
What you can see
- AI crawler name and category
- Pages crawled on your website
- Crawl activity over time
- Traffic from AI answers, indexing, and training bots
Browse the full list of supported bots in the Crawler Directory.
Recent updates
