Ahrefs by
the numbers
Ahrefs collects, processes, and stores large amounts of data for search marketing professionals.
Similar to search engines, we crawl the entire web 24/7 and store petabytes (1PB = 1000TB) of information about live websites – like how they link to each other and what keywords they rank for in search results.
We're also really proud of our backend infrastructure. Since no existing solution could keep up with the volume of data we operate, most of our software infrastructure was built in-house.
3400
Servers
625
K
CPU cores
4
PB
RAM
33
PB
HDD
405
PB
SSD
$900
m
The amount we’d have to spend on the cloud in 3 years without our own infrastructure.
Most active web crawler in the SEO industry
AhrefsBot is the most active web crawler in the “Search Engine Optimization” category on Cloudflare Radar. It’s also the 3rd most active web crawler in the world.
Every minute, we crawl
There are
5
M
170
T
Sayfalar
Rows in our key-value database
Rank | Bot | Owner | Category |
|---|---|---|---|
1 | GoogleBot | Search Engine Crawler | |
2 | BingBot | Microsoft | Search Engine Crawler |
3 | DataDog Synthetic Bot | DataDog | Monitoring & Analytics |
4 | AhrefsBot | Ahrefs | Search Engine Optimization |
5 | Qualys | Qualys | Search Engine Crawler |
6 | YandexBot | Yandex | Search Engine Crawler |
7 | PetalBot | Huawei | Search Engine Crawler |
8 | Google AdsBot | SAdvertising & Marketing | |
9 | Google Image Proxy | Page Preview | |
10 | Google Images | Search Engine Crawler |
Bots ranked by number of requests. Data supplied as of April, 2023
Content index
Our content index powers Content Explorer, which is basically a content search engine.
Every 24 hours, we discover
10
M
New pages
Every 24 hours, we update metrics for
300
M
Sayfalar
Total content index size
14.0Milyar
Sayfalar
Keyword index
This powers Keywords Explorer, our keyword research tool for finding what your prospective customers are searching for online.
216
Konumlar
Total keyword index size
20.4Milyar
Anahtar kelimeler
Organic search traffic index
Our database of search queries and the amount of search traffic they send to top-ranking pages. It powers search traffic estimations in Site Explorer.
189
Konumlar
651
M
Anahtar kelimeler
Backlink dizini
The world's largest index of live backlinks, updated with fresh data every 15–30 minutes. This index powers backlink data in Site Explorer, and is used to calculate our proprietary metrics: Ahrefs Rank, Domain Rating and URL Rating.
External backlinks history
35.0Trilyon
Records
Dizindeki sayfalar
345.2
B
Domains (post-vetting)
210.5
M
Dahili bağlantılar
23.9
T