How to Use Ahrefs Site Explorer to Spot Unnatural Links Quickly

Tad Chef
Tad Chef writes for SEO blogs from all over the world including his own one called SEO 2.0. He helps people with blogs, social media and search, both in German and English. You can follow Tad on Twitter @onreact_com to get his latest insights daily.

Article stats

  • Referring domains -
  • Organic traffic -
Data: Ahrefs' Content Explorer

    There are specialized and sometimes expensive tools helping you to find so called “unnatural links” leading to your site. The fear Google spreads makes website owners spend money on them. At the same time site explorer software like the one we offer at

    Ahrefs is perfectly enough to spot most unnatural links.

    Specialized link detox tools are only needed in very difficult cases.

     

    Getting your hands dirty

    I’ve recently had a client who had a so called “unnatural links penalty”. It was a large site by an even larger publishing house. I usually do not accept menial labor like cleaning up behind some dirty link builder but this time I wanted to only use Ahrefs to determine the bad links in question. Oh boy! I’ve found so many potentially harmful links just by using our Site Explorer and Google Webmaster Tools that I didn’t even have to look further.

     

    Natural links and hot ice

    Of course Google Webmaster Tools should always be your first source of information on your “unnatural links”. Get the information right from the horse’s mouth. After all it was Google that even coined the somewhat paradoxical term “unnatural links”. Remember that links are part of the Web and thus technology. In essence “unnatural links” are like “cold ice”. Links are always unnatural per definition.

    Links are not growing naturally in your garden.

    Google’s more than 15 years old link based algorithm has been improved or rather complicated over the years. The new bloated version still can’t really cope with links that are solely placed to mislead search engines. Thus Google has shifted the responsibility for fixing their algorithm to the webmasters. That’s why they declared some links to be unnatural.

     

    Repent your sins or burn in hell!

    In case you want to get people to find you via Google — the de-facto global search traffic monopolist — you have to play by Google’s rules, otherwise the gatekeeper won’t let anybody through to your site.

    Of course you could ignore Google altogether and focus on other traffic sources, like mail, social media or direct traffic for example but most site owners have grown so dependent on Google search that they can’t even imagine taking this step.

    So the only thing that you can do is to follow Google’s path of repentance for sinners.

    First you have to find out where you have sinned and how. Have you built links “artificially”? In many cases someone else did it on your behalf. Sometimes even your competition might be responsible for your tanking on Google.

    Another term that sounds as if coined by the Google PR department: “negative SEO”.  It scares website owners into using paid search (Google Adwords). Now that Google officially allows sites to be attacked by links anything is possible and it’s a wild west mentality out there.

     

    Another annoyance created by Google

    You have to find all the links that look “dodgy” and remove them or “disavow” them. It’s easy for spammers who know exactly where they have built links. They just need to plug a site out of their linkfarm that has been busted or simply throw away the domain altogether. Sadly legitimate webmasters like you and me aren’t so lucky. Sometimes I wish I spammed Google in the past.

    Finding the links that bother big Google is quite a nuisance to say the least.

    I won’t explain all kinds of unnatural links here again. There are many resources out there that already do that. I have written back in 2011 how to spot them. No, today I will cover the methodology of spotting unwanted links with the Ahrefs Site Explorer. Google Webmaster Tools shows most of them but it’s pretty hard to find them in the huge unstructured list that GWT offers. With Ahrefs it’s easy. Let’s start with the simple ones.

     

    Site-wide links

    One of the first things to look for when trying to find unnatural links are so called site-wide links. This kind of link is pretty self-explanatory. It’s a link from (almost) every single page on a given domain. There are a few common cases where a site links out to another site on every single page.

    Most site-wide are automated as nobody links to a third party manually on each page.

    The most natural site-wide links are so called blogrolls on WordPress or Blogger blogs for example. A blogroll is a list of similar blogs or blogs run by friends of a blogger. Blogrolls aren’t as common as they once were (simply because nobody really looks at blogrolls and clicks the links in them).

    In Ahrefs Site Explorer you just need to enter the domain name you want to test and to click “INBOUND LINKS -> Referring domains”. You’ll see the site-wide links on top. See partial screen shot below:

    ahrefs-sitewide-links

    The first site links 84,258 times to my client. That’s a lot of links. Also the third and fourth domains in this list raise huge red flags. Why? Look at the Alexa traffic rank! Whoa. They have links the fifth most trafficked website in the world according to Alexa. These are two subdomains from Yahoo, one of the largest sites of the world.

    Any site that points thousand or more links at you looks a bit strange. So you might want to check those first. Not all of them have to be unnatural according to Google’s quite nebulous guidelines but some of them might be and that’s the first place I look usually.

     

    Links from abroad

    As I live and work in Germany I often have German clients who only serve the local German speaking market (Germany, Austria, Switzerland, parts of Italy). It’s logical that the links should be in German as well then. Of course there can be natural links from abroad. I’m the best example.

    I have a site that gets lots of links from the US, UK and the rest of the world simply because I blog in English. I didn’t have an English version of my homepage from day one either. My articles have been translated into dozens of languages with the likes of Chinese, Russian, Thai, Persian among them.

    Yet in most cases it’s at least weird when Chinese or Russian sites link to you even though you only serve a local market.

    This also applies to American or British sites. Just because many people speak English in the world doesn’t mean that a plumber from Iowa can be “big in China”.

    In Ahrefs Site Explorer you can simply click “INBOUND LINKS -> Referring domains -> ALL TLDS and you already see a drop-down menu of the country level domains from abroad. See the partial screen shot below here:

    ahrefs-tlds

     

    In my case this wasn’t a big problem. The site has 644 TLDs (Top Level Domains) linking to it. Most of them from Germany, international ones like .com, .net, .org, from Austria, Switzerland and just a few from China and one from Hong Kong. I checked them out nonetheless of course. The links from the Netherlands are a bit suspicious because they don’t speak German over there so I looked all of them up as well.

     

    SPAM links (comments, forums, guest books)

    Now that Google allows third party sites to hurt you just by linking to you Google sabotage has become more common. It has been practiced for years in the underground and was referred to as Google Bowling but in recent years we have a wave of so called “negative SEO”. This term is of course nonsense, just like “unnatural links” but a welcome phrase to scare people from using SEO.

    There are numerous ways to sabotage sites in Google, pointing SPAM links at your competition is a common one

    due to the change in Google’s policy to penalize sites for links from third party sites.  Someone simply pays a spammer to create thousands of links to your site by spamming blogs, forums, guest books and other types of sites that allow link insertion. Most of these sites try to protect themselves by using the so called nofollow attribute as advised by Google. The nofollow attribute won’t prevent SPAM but it can show us where to look for SPAM links.

    ahrefs-nofollow

    In Ahrefs Site Explorer just click “INBOUND LINKS -> Referring domains -> NOFOLLOW to find potential culprits. Then you’ll see a list of the domains that point at least some links that use nofollow to you. The attribute nofollow usually means “I don’t trust this site, or I don’t know this site so I can’t vouch for it”. In other words

    too many “nofollow” links make you look not trustworthy by itself.

    In case these links are part of boilerplate comments like “thank you great post” you are in real trouble. Of course spammers do not target nofollow sites only so that you get a lot of links from both nofollow sites and sites that “trust” you.

    Google tells us that nofollow prevents it from crawling the links but many experts in the SEO industry believe that Google still considers them to be red flag. Thus too many nofollow-links can pose a problem even without being automated SPAM. In case most of your links stem from your commenting practice on blogs you might have a problem that way.

    By clicking “BACKLINKS” in the list on the right you can check out each domain that appears somewhat different than what you’d expect from an editorial link added by a writer in an article for example.

     

    Text link ads (paid links)

    The actual links Google is really on the lookout for are so called “paid links”. This is of course another Google PR term. Such links have been called text link ads before Google declared them to be “unnatural” in 2007.

    Many bloggers made some decent money from text link ads which competed with Google Adsense back then. Then Google decided that the only text links ads acceptable are Google Adsense ads and every other ad needs to use the nofollow attribute as a “link condom” to prevent “Google juice” to flow.

    Many companies that have openly offered text link ads went out of business.

    Millions of publishers, bloggers and website owners have been penalized for accepting or selling text link ads. Yet Google is still unable to distinguish between editorial links that haven’t been paid for and ads. Thus they ask everybody to snitch on others or declare yourself guilty by using the so called disavow tool.

    Many sites depend so much on Google traffic that they are willing to incriminate themselves once they get an “unnatural links” warning. They confess to have paid for links and hope to get back up in Google.

    Of course anybody can buy links for you as part of Google sabotage

    as mentioned above. So you have to check them in any case once you want to get rid of the unnatural links penalty the Google way. Sadly it’s not as easy as with the other “unnatural links”. That’s why Google can’t find them by itself either.

    In some case you might even have paid for ads even without knowing that they are not within Google guidelines. After all Google is not the government so why should you play by their rules? You haven’t voted for them to rule you, have you?

    Text link ads meant to “manipulate PageRank” usually don’t use the nofollow attribute to make sure Google counts them.

    As noted above Google sabotage using SPAM links that have been paid for by your competition can be mostly “nofollow” though. Here we focus on ads you might have bought yourself without realizing that Google owns the Internet and can forbid you to use competing services.

    In Ahrefs Site Explorer you need to click “INBOUND LINKS -> Referring domains -> DOFOLLOW -> Domain Rank” to locate the most obvious high PageRank links that have been paid for.

    Another common clue to find out whether links are paid for is so called anchor text. Anchor text is the text used to link to a site. You would usually use the site’s name to link to it. So “Amazon” would be the anchor text to link to Amazon.com. In contrast “buy cheap books” would be an anchor text that looks manipulative and could be paid for.

    In Ahrefs Site Explorer you need to click “INBOUND LINKS -> Anchors”. There on the left you’ll see all the words people have used to link to you. In case there are keywords in that list, make sure to check the sites that have used them.

     

     

    Links from same IP (range)

    Every item on the Web has a so called IP so that you can identify and find it. Websites have IPs too. Usually these IPs are the same or very similar in case several websites are owned by the same person or company.

    Sophisticated link networks or link farms use different IPs but there are still a lot of rather obvious link farms created by amateurs either because they don’t know what they are doing or because they know it but aren’t good at it.

    Having several, dozens or even hundreds of links from the same IP or even the same IP range can be thus problematic. You usually can’t see the IP of a given website so some people assume Google can’t see them either. Even we at Ahrefs can spot links fro the same IP or IP range /where at least 3/4 of the IP are the same).

    In Ahrefs Site Explorer you have to click “INBOUND LINKS -> Referring IPs”:

    ahrefs-referring-ips

    In the case of my client there were some very obvious link networks, just because the company is huge and has lots of properties. Interlinking their own sites has been working well for most brands but it doesn’t mean that these link are considered natural by Google.

    Like site-wide links they are probably automated in most cases and selfish in nature. Just because you link to yourself all the time doesn’t mean you are popular on the Web.

     

    Still not satisfied?

    OK, so you have checked all the links above and haven’t found enough to fix or remove? Well, then you may need some link detox tools. Believe me though, you will rather find a lot more than you think.

     

    * Creative Commons image by darkday

    Tad Chef
    Tad Chef writes for SEO blogs from all over the world including his own one called SEO 2.0. He helps people with blogs, social media and search, both in German and English. You can follow Tad on Twitter @onreact_com to get his latest insights daily.

    Article stats

    • Referring domains -
    • Organic traffic -
    Data: Ahrefs' Content Explorer

    Get notified of new articles

    47,266 marketers are already subscribed to Ahrefs blog. Leave your email to get our weekly newsletter.