AI Bot Activity
How AI assistants, AI search engines, crawlers and agents crawl the web over time.
20 AI bots tracked
772 sites in cohort
Analyzed for Apr ’26 – Sep ’26
Based on data from Bot Analytics
Updated: Oct 2, 2026
AI bots over time — by bot
Top 20 individual AI bots (assistants, AI search, crawlers, agents).
Click legend items to show/hide bots. “Share of bot traffic” = each bot’s requests ÷ total bot requests.
See which bots crawl your website and where they waste your crawl budget with Ahrefs Bot Analytics →
AI bot traffic over time — by industry
Which industries AI bots crawl most (website industry from Ahrefs’ domain classifier).
“Share of AI bot traffic” = each industry’s AI-bot requests ÷ total AI-bot requests (sums to 100%). “Unknown” = domains Ahrefs hasn’t classified.