Bot Analytics

See which bots crawl your website and stop the bad ones

Optimize your crawl budget by tracking every bot hitting your website and the pages they crawl the most.

Inscrivez-vous à Ahrefs

Disponible pour tous les plans payants en version bêta.

What makes Ahrefs Bot Analytics different

Server-side tracking

Captures all bot activity via Cloudflare. No JavaScript required.

Server-side tracking illustration

Works independently

Runs separately from Web Analytics without affecting your setup.

Works independently illustration

12+ bot categories

Tracks search engines, AI crawlers, SEO tools, social bots, and more.

AI bots filter

One toggle to instantly isolate AI bot traffic across all reports.

AI bots filter illustration

Get full visibility with bot insights. From AI crawlers to search engines and social bots.

Bot insights view showing bot categories and activity
Search Engine
Security
Advertising
AI Crawler
Monitoring
Service Agent
Social Media
AI Assistant
SEO Tool
Feed Fetcher
AI Search
Other

See which bots waste your crawl budget by hitting 404s or low-value pages. Improve crawl efficiency and indexability.

404 pages report grouped by bot activity

Set up Ahrefs Bot Analytics in seconds with a Cloudflare integration

1
Open your project in Ahrefs and go to Settings → Bot Analytics.
2
Choose your integration method: Cloudflare Logpush or Worker*.
3
Start seeing your bot data instantly. No code changes or JavaScript required.

*

Cloudflare Logpush sends HTTP logs to Ahrefs automatically. Best for high-traffic sites. Requires Cloudflare Enterprise.

Cloudflare Worker runs a lightweight script on each request. Works with any Cloudflare plan.

Stop bad bots and crawl budget waste. Optimize your crawl efficiency.
23921 users joined Ahrefs in the last 7 days
Inscrivez-vous à Ahrefs

Des questions ? Nous avons des réponses

  • What is bot traffic?

    Bot traffic is any visit to your website made by an automated program — search engine crawlers, monitoring tools, AI assistants, scrapers, and malicious bots — rather than a human. On most websites, bots make up a significant and growing share of total traffic, wasting significant crawl budget in the process. According to Ahrefs data, AI bots alone accounted for nearly 25% of all bot requests in May 2025. Read the full study →
  • What’s the difference between good bots and bad bots?

    Good bots have a legitimate purpose and follow the rules. For example, Googlebot crawls your site to rank it in search, and AhrefsBot crawls the web to power the backlink and keyword databases in Ahrefs. Bad bots scrape content without permission, probe for vulnerabilities, or generate noise that bloats your server logs and distorts analytics. The distinction matters: blocking the wrong bots can hurt your SEO data quality.
  • How does bot traffic affect my website and SEO?

    Two ways. First, uncontrolled bot traffic wastes crawl budget — bots crawling 404 pages or low-value URLs aren’t crawling the pages you need indexed. It’s estimated that over half of all crawler traffic is wasted effort. Second, if bot traffic isn’t separated from your analytics, it inflates session counts and distorts behavioral data, making it harder to make sound decisions. Ahrefs Bot Analytics gives you visibility into both problems, without touching your existing analytics setup.
  • Does Ahrefs Bot Analytics replace Ahrefs Web Analytics?

    No — they serve different purposes. Ahrefs Web Analytics tracks human visitors and behavioral data. Ahrefs Bot Analytics tracks automated traffic server-side. They run independently, so enabling one doesn’t affect the other.
  • Does Ahrefs Bot Analytics require a JS tracking script?

    No. It works entirely via Cloudflare integration, server-side. This means it captures bot traffic that JavaScript-based tools would never see.
  • Is Ahrefs Bot Analytics free?

    Yes. Ahrefs Bot Analytics is free during beta, available on all paid Ahrefs plans.

Vous avez d'autres questions ?

Si vous avez d’autres questions, nous contacter afin que nous puissions vous aider.