This is the new Site Audit tool by Ahrefs

Tim Soulo

Tim is the guy responsible for marketing and product strategy at Ahrefs. But most importantly he’s the chief evangelist of the company. Learn more about Tim

Article stats


    More than a year ago, we removed our old and outdated Site Audit tool from Ahrefs and announced that we were going to build a shiny new one from scratch.

    We were hoping that we’d be able to deliver the new tool in 6–8 months. But in all honesty, we were a little over-ambitious with its functionality and encountered a few “bumps” along the way.

    So, after a rather long wait, the new Site Audit tool is finally released!

    Before I get into more detail with features and reports, let me share some of the things that make it so awesome:

    It is cloud-based — You don’t need to install any software on your computer and you don’t need to own any servers or proxies to run it on a large website. Just click “Start crawl” and we’ll handle the rest.

    It is blazingly fast — According to our backend team, our Site Audit tool can crawl faster than most websites can handle (which should not come as a surprise, considering that Ahrefs has the second best crawler after Google). But you’re only allowed to increase the crawl speed if you verify the ownership of that website.

    It has 100+ pre-configured SEO issues — And you have full control over them: modify them to your liking, remove those you don’t like and add any custom ones. This allows you to create a unique list of issues for every project (if needed).

    It has Ahrefs’ backlink and traffic metrics integrated — No need to cross reference data between different tools. You’ll have all the SEO metrics that you care about in one place.

    It is visual — Many of the aforementioned SEO issues are visualized with cool graphs and then grouped into reports, which makes the data much easier to grasp and explain to your clients. We have both: the graphs of the current snapshot of your website’s health, as well as your progress over time.

    It saves each crawl — This way you can always go back and review previous crawls if needed. The option to compare crawls is in the pipeline already.

    It will support JavaScript Rendering — This will be added in about ~2 weeks from now.

    It will support Lighthouse — This one is in the pipeline right after JavaScript rendering.

    And now let’s take a closer look at the functionality of the new Site Audit tool.

    1. Crawl settings / Scheduling

    Upon starting a new project, you get full control over what we crawl and how fast we crawl it.

    crawl seetings ahrefs site audit

    Here are some of the settings that you can configure:

    • You can start crawling from: homepage, sitemaps, list of URLs having backlinks (as known by Ahrefs) or your custom list of URLs.
    • You can specify crawl depth and the files and resources that you want us to crawl.
    • You can include and exclude URLs and specify URL rewrite rules (using regex).

    And, finally, you can easily schedule subsequent crawls with very precise timing:

    scheduling a crawl in ahrefs

    2. Real-time crawl log

    It takes us just a few seconds to start crawling your website and we immediately show you a real-time Crawl log with the status of each item:

    real time crawl log ahrefs

    This is very handy; you won’t need to wait for the crawl to finish just to see that something went wrong.

    For instance, you might overestimate what your server can handle and set up a crawl speed that is a tad too fast, which will result in most pages timing out. If that happens, you’ll see these “time outs” instantly in your crawl log and will be able to stop that crawl immediately and re-configure it.

    3. Issues / Reports

    In a similar fashion to the Crawl log, we start building all reports in real-time, using the data that we’ve collected so far:

    site audit overview

    As of today, Ahrefs’ Site Audit tool will monitor your website for the 100+ most common SEO issues.

    And you can easily modify any of them, remove those you don’t agree with and add your own custom ones.

    Many of these issues are grouped into cool visual Reports that are listed in the left-hand menu.

    reports in site audit

    Everything in these reports is “clickable” — just click on the item that you would like to focus on and you’ll be redirected to the corresponding “view” in Data Explorer with a list of all affected pages.

    You also get a handy “top level” filter that allows you to quickly rebuild any report for a specific subset of pages.

    For example, you can look at all your /blog/ pages without having to setup a new project:

    top level filter site audit

    4. Data Explorer

    This is the heart and soul of Ahrefs’ Site Audit tool. We give you all the raw data that we have crawled, so that you can slice and dice it in any way you want (and export to CSV, if needed).

    We save 150+ data points for each URL and you can build rather complex filtering logic with our “AND/OR” function and grouping support:

    filters in data explorer

    You can then save the whole thing as a custom issue and use it in other projects that you have in the Site Audit tool.

    5. Progress graphs

    The reason why you want to crawl your website for SEO issues is to get them fixed, right?

    And the reason why you want to then re-crawl your website again is to see how many more issues are left and what your progress is, as compared to the previous crawl.

    That’s why our new Site Audit tool has quite a few different graphs to illustrate your progress over time — both on project-level and for each individual issue.

    More updates are coming

    As usual, the fact that we have released our Site Audit tool doesn’t mean that we have stopped working on it.

    We have quite a few things in the pipeline for the next few months:

    • Description of each issue (+ how to fix) — A lot of our customers are not very experienced in SEO, so we’ll gladly give them clues as to why each issue is important (or not) and how to fix it.
    • Schema.org & AMP support — Even though these are not considered direct ranking factors, they may have a profound impact on your visibility in Google SERP, which makes them important to monitor.
    • Comparing crawls — This one should be pretty dope. You’ll not only be able to easily see which pages were fixed since last crawl (and if any new ones are affected with that same issue), but we’ll also show you the exact changes: what Title your page used to have versus the current one, along with which outgoing links were removed from the page, which ones were added, and so on and so forth.
    • HTML data extraction — We’re going to save the full HTML code of your pages so that you’ll be able to use regex to extract any data you may need. For example, if you decide to check which of your pages have the Facebook tracking pixel code installed, you won’t need to re-crawl your website — because all data is already there.
    • On-page report — This one should be self explanatory. The plan is to try to aggregate all the useful data that we have on your page into a single actionable report.
    • Site structure visualisation — It often helps a lot to see a “map” of how the pages of your website are all interlinked. Which is why we’ve planned it for our Site Audit.

    So these are some of the things that we already know we need to add in order to make our Site Audit tool even more awesome.

    But we’re always open to your feedback!

    If you have any feature requests, please feel free to post them here: https://ahrefs.canny.io/site-audit (or upvote those that someone else has already posted).

    We know that there are a lot of cool issues, graphs and reports that could be added to Site Audit and your input will help us prioritise our roadmap.

    Tim Soulo

    Tim is the guy responsible for marketing and product strategy at Ahrefs. But most importantly he’s the chief evangelist of the company. Learn more about Tim

    Article stats

    Shows how many different websites are linking to this piece of content. As a general rule, the more websites link to you, the higher you rank in Google.

    Shows estimated monthly search traffic to this article according to Ahrefs data. The actual search traffic (as reported in Google Analytics) is usually 3-5 times bigger.

    This is the new Site Audit tool by Ahrefs
    5 (100%) 5 votes

    Get notified of new articles

    46,464 marketers are already subscribed to Ahrefs blog. Leave your email to get our weekly newsletter.

    • Here’s the thing, it’s a long update, an update we’ve been waiting for. You’re doing great work.

    • Yulian Alinski

      Still kind of broken though. Will wait for the fixes before I’m gonna add more projects. Also, the interface hurts my eyes. I also noticed that the crawl speed is find of slow. Don’t get me wrong — it’s better than the old one. Just not reliable yet.

      • hey Yulian. I think you’re being a bit harsh on us. It’s true that the tool is very “young” and we still have a few bugs here and there, but I won’t call it “broken” or “not reliable.”

        As for the crawl speed — you can configure it and make it super fast if you verify the ownership of the website. Please also keep in mind, that the crawl speed is often limited by the powers of your website hosting.

        Overall, our goal is to create the Site Audit tool that all our users would be super happy with. So in case you have any bugs to report or any feedback to share — please don’t hesitate to reach out to our support team.

        • Yulian Alinski

          Like I said, don’t get me wrong. Not here to hate or anything. Let’s see what happens 🙂

    • Emil Wallgren

      Keep up the good work! Ahrefs is (for me) by far the best tool for SEO and you just made it even better! 🙂

    • Great job again, Tim.

    • your current crawler is just like google’s cassandra at that time, also your crawler is second best then why not start your own search engine, this way all my sites will rank on top position on your engine

    • Good job Tim! Will wait for the upcoming updates. 🙂

    • Very nice. Will check it out.

    • Sam Thomas Davies

      Outstanding work, Tim. Couldn’t ask for more.

    • Shaun mengella

      Very comprehensive tool, although 1 suggestion i would make is that once problems have been diagnosed by the software, then give best recommendations on how to correct such issues.

    • Bill Widmer

      THIS IS AMAZING!!! Can’t wait to use it for all my clients! 😀

    • Can’t wait to give it a spin. Now I don’t have to sign up for a premium Deepcrawl account.. I think a log analyzer function will be amazing so we don’t have to rely on a 3rd party tool for that task.

    • Awesome. Thank Tim and ahrefs team. Will try it.

    • Going to test it all out today — nice work 🙂

    • That’s Awesome, This is needed. Thanks

    • Great.Let us try out. Hope it will be very helpful.

    • Shawn Huber

      My IT blocks crawlers that are unknown — where can I get a list of the IP addresses that the audit tool crawls from?

    • Hi Guys, I’ve been playing with the Site Auditor for the past week or so and it does a really great job. Visually pleasing and very handy for taking action on sites. The only thing I see it lacking curently is the ability to export the report or save sections to a PDF. The ability to show a client what is wrong, or what has been fixed, is important, and while we can log in and show them when sitting side-by-side, it’s not ideal.

      Are there plans to make the reports exportable? If so, this will likely replace my other two softwares that I use on initial site audits for clients.

      Keep up the great work!

    • @TI@timsoulo:disqus Great to see the old Domain Health feature has resurrect! What is the server location of the Ahrefs bot? Because the section “performace” is heavily influenced by it. I get over 75% slow pages for a certain domain of what I am sure of it is bloody fast, compared it with GTmetrix results, Pingdom Tools etc. These tools I use EU based test server locations.

      Hope you can clear this matter, keep up the goodwork!

    • Clare Hoang

      so many cool things must try with this new Site Audit tool.

    • Great work @timsoulo:disqus & the rest of the Ahrefs team. I’ve already tested it out and it’s blowing the other tools I used to use out of the water.

    • Data explorer column “Organic Traffic” by snity check I immediately knew the numbers I saw there were not Organic only but at least CPC + Organic.

      Don’t get me wrong…I do appreciate having back a domain health tool but.….the inaccuracy bothers me. Same thing with the NEW Rankchecker, which includes image pack ranking, this gives a totally incorrect view on the rankings.…

      It’s better to call these tools Beta

    • It good decision to add Site Audit. Its looks similar to Ryte. Let’s test it 🙂

    • So many things included in the tool, audit, error checking, backlinks, top pages, live traffic, and so on… really great job

    • Hope it will be very helpful. This is needed. I will try it.

    • Hi, Site Audit great tool, thanks for good job

    • i will try it.

    • Liz Madeley

      Just having a look and play around with the tool now. What is the default limit of URLs that will be crawled? Thanks!