We’re powered by seriously big data

Ahrefs collects, processes, and stores large amounts of data for search marketing professionals.

Similar to search engines, we crawl the entire web 24/7 and store petabytes (1PB = 1000TB) of information about live websites – like how they link to each other and what keywords they rank for in search results.

We're also really proud of our backend infrastructure. Since no existing solution could keep up with the volume of data we operate, most of our software infrastructure was built in-house.

4000
Servers
921
K
CPU cores
6
PB
RAM
33
PB
HDD
680
PB
SSD

$900
mn
The amount we’d have to spend on the cloud in 3 years without our own infrastructure.
Watch reel

Meet Yep1, our superfast supercomputer

Yep1, Ahrefs’ supercomputer, ranks among the Top 50 fastest supercomputers worldwide by Flops (floating point operations per second).

Data supplied as of May, 2024. See full report

23.32
PFlops

Most active web crawler in the SEO industry

AhrefsBot is the most active web crawler in the “Search Engine Optimization” category on Cloudflare Radar. It’s also the 3rd most active web crawler in the world.

Every minute, we crawl
5
M
Sidor
There are
170
T
Rows in our key-value database
/

Rank

Bot

Owner

Category

1

GoogleBot

Google

Search Engine Crawler

2

BingBot

Microsoft

Search Engine Crawler

3

DataDog Synthetic Bot

DataDog

Monitoring & Analytics

4

AhrefsBot

Ahrefs

Search Engine Optimization

5

Qualys

Qualys

Search Engine Crawler

6

YandexBot

Yandex

Search Engine Crawler

7

PetalBot

Huawei

Search Engine Crawler

8

Google AdsBot

Google

SAdvertising & Marketing

9

Google Image Proxy

Google

Page Preview

10

Google Images

Google

Search Engine Crawler

Bots ranked by number of requests. Data supplied as of April, 2023


Content index

Our content index powers Content Explorer, which is basically a content search engine.

Every 24 hours, we discover
10
M
New pages
Every 24 hours, we update metrics for
300
M
Sidor

Total content index size

15.4B

Sidor


Keyword index

This powers Keywords Explorer, our keyword research tool for finding what your prospective customers are searching for online.

216
Platser

Total keyword index size

12.0B

Filtered keywords

74.0B

Keywords ever seen

1.1BUnited States
452mnUnited Kingdom
391mnIndia
286mnCanada
282mnGermany
271mnRussian Federation
251mnBrazil
222mnJapan
215mnFrance
204mnAustralia
179mnIndonesia
169mnPhilippines
169mnSpain
165mnMexico
153mnItaly
145mnTurkey
137mnNetherlands
137mnVietnam
124mnPoland
122mnKorea
112mnArgentina
109mnUkraine
107mnMalaysia
95mnColombia
95mnTaiwan
87mnThailand
85mnPakistan
82mnSouth Africa
81mnSwitzerland
79mnBelgium
76mnEgypt
76mnIran
74mnSingapore
73mnSweden
71mnPeru
68mnChile
67mnAustria
67mnUnited Arab Emirates
62mnSaudi Arabia
59mnBangladesh
59mnIreland
56mnRomania
53mnPortugal
53mnNew Zealand
49mnHong Kong
47mnMorocco
47mnNorway
46mnCzech Republic

1.1BUnited States
452mnUnited Kingdom
391mnIndia
286mnCanada
282mnGermany
271mnRussian Federation
251mnBrazil
222mnJapan
215mnFrance
204mnAustralia
179mnIndonesia
169mnPhilippines
169mnSpain
165mnMexico
153mnItaly
145mnTurkey
137mnNetherlands
137mnVietnam
124mnPoland
122mnKorea
112mnArgentina
109mnUkraine
107mnMalaysia
95mnColombia
95mnTaiwan
87mnThailand
85mnPakistan
82mnSouth Africa
81mnSwitzerland
79mnBelgium
76mnEgypt
76mnIran

1.1BUnited States
452mnUnited Kingdom
391mnIndia
286mnCanada
282mnGermany
271mnRussian Federation
251mnBrazil
222mnJapan
215mnFrance
204mnAustralia
179mnIndonesia
169mnPhilippines
169mnSpain
165mnMexico
153mnItaly
145mnTurkey


Organic search traffic index

Our database of search queries and the amount of search traffic they send to top-ranking pages. It powers search traffic estimations in Site Explorer.

189
Platser
597
M
Sökord
159mnUnited States
32mnIndia
26mnJapan
24mnFrance
24mnUnited Kingdom
22mnBrazil
22mnGermany
20mnCanada
19mnSpain
18mnRussian Federation
17mnAustralia
15mnItaly
13mnMexico
13mnNetherlands
12mnIndonesia
11mnTurkey
9.4mnPoland
6.9mnThailand
6.8mnColombia
6.6mnPhilippines
6.5mnArgentina
5.7mnVietnam
4.7mnUkraine
4.7mnSweden
3.8mnTaiwan
3.5mnMalaysia
3.3mnChile
3.1mnSouth Africa
3.0mnDenmark
3.0mnNorway
2.9mnPeru
2.7mnSaudi Arabia
2.7mnPakistan
2.7mnEgypt
2.7mnAustria
2.5mnCzech Republic
2.5mnNew Zealand
2.5mnKorea
2.4mnBelgium
2.2mnUnited Arab Emirates
2.1mnPortugal
2.0mnRomania
1.9mnFinland
1.9mnHungary
1.9mnSingapore
1.9mnSwitzerland
1.9mnGreece
1.8mnHong Kong

159mnUnited States
32mnIndia
26mnJapan
24mnFrance
24mnUnited Kingdom
22mnBrazil
22mnGermany
20mnCanada
19mnSpain
18mnRussian Federation
17mnAustralia
15mnItaly
13mnMexico
13mnNetherlands
12mnIndonesia
11mnTurkey
9.4mnPoland
6.9mnThailand
6.8mnColombia
6.6mnPhilippines
6.5mnArgentina
5.7mnVietnam
4.7mnUkraine
4.7mnSweden
3.8mnTaiwan
3.5mnMalaysia
3.3mnChile
3.1mnSouth Africa
3.0mnDenmark
3.0mnNorway
2.9mnPeru
2.7mnSaudi Arabia

159mnUnited States
32mnIndia
26mnJapan
24mnFrance
24mnUnited Kingdom
22mnBrazil
22mnGermany
20mnCanada
19mnSpain
18mnRussian Federation
17mnAustralia
15mnItaly
13mnMexico
13mnNetherlands
12mnIndonesia
11mnTurkey


Länkindex

The world's largest index of live backlinks, updated with fresh data every 15–30 minutes. This index powers backlink data in Site Explorer, and is used to calculate our proprietary metrics: Ahrefs Rank, Domain Rating and URL Rating.

External backlinks history

35.0T

Records

Pages in index
325.8
B
Domains (post-vetting)
207.1
M
Interna länkar
22.3
T

© 2024 Ahrefs Pte. Ltd. (201227417H) 16 Raffles Quay, #33-03 Hong Leong Building, Singapore 048581