Ahrefs team takes great pride in collecting, processing and storing large amounts of data for search marketing professionals.
We crawl the entire web 24/7 (much like search engines do) storing petabytes of information about live websites — how they link to each other and what keywords they rank for in search results.
We process large amounts of clickstream data to maintain the world's biggest third party database of search queries with refined monthly search volume and advanced keyword research metrics.
Browse this page to explore the scale of data that powers Ahrefs marketing tools.
Our content index is basically a mini search engine. You can search for any word and we'll return all pages, mentioning that word with our useful SEO metrics attached to them.
Every 24 hours we discover5 million new pages
Every 24 hours we update metrics for72 million pages
Total content index size831 million pages
Full updateEvery month
We operate two independent keyword indexes. The larger one (5.4 billion) is used for studying search patterns of internet users (via Keywords Explorer). The smaller one (530 million) is used for researching the search queries that websites rank for in organic search results (via Site Explorer).