Best way to filter out the nofollowed links from WMT?
-
When I'm downloading links from WMT to audit them for my unnatural links clients I generally check each individual link. If it is a nofollowed link I make a note that it is nofollowed and move on. I'm thinking that there has to be a quicker way to find all of the nofollowed links so that I can filter them out from the beginning. How would I do that?
-
Yes, that's right. What you'd end up with is a small list of URLs that have nofollow anywhere/somewhere on the page. If it's a big list of 5000 links and this tool can trim it down to maybe 200 having nofollow somewhere or 500 or 2000. In either case, it's a small list. Definitely not a solution to what you are looking for.
-
Hmmm...interesting. I was just playing with screaming frog and thought I had it because you can upload a list of links and then when you export them there is a column for "nofollow", but that column means that the page is nofollowed. That means that a nofollowed link from a meta robots follow,index page would not be flagged.
I see what you're saying about searching for nofollow on the page, but I can't see it being specific enough. A lot of pages may have for example nofollowed comment links but my link in the article could still be followed.
-
Marie
What you could do is use Screaming Frog to crawl all the links (the combined list of ahref links and WMT and then use the custom filter to check if the domain is there, ie your link is there and then the 2nd filter to check if there is the word nofollow anywhere on the page. It's not going to be a perfect list, because you may end up seeing a page that is linking to you, but is nofollow'ing somebody else from the same page.
But then most of the times, the regular links, they are either nofollowed or they are not. "Mostly".
I hope this helps.
-
agreed and good point. (That is why we end up with soooo much SAS).
Thanks -
Thanks Robert. Yes, I usually do use ahrefs and the links from there are nicely marked as nofollowed and easy to filter out. I generally combine the links from ahrefs with the links from WMT and remove the duplicates.
I find that often there are links that are only on one list and not both. For small sites that's not a big deal, but for a large site there may be thousands of nofollowed links that only exist on the WMT list. I figured that if I could find a way to filter out the nofollowed links from the WMT list as well then this would save me a lot of time.
-
Marie,
Have you used ahrefs.com before?
If not I think it will be very useful to you given that I know what you do. I took a small site we handle and looked at what I have in WMT and then ran it on ahrefs. On WMT we are showing 68 distinct external links. On ahrefs we are showing 62. Worst case about a ten percent difference. (For finding those 6, download both csv files and sort and should be quick. Obviously with thousands you have more work.)
With ahrefs, you can simply sort them by nofollow, mark your GWMT data, then boom. You are real close to magic.If you want to see it, etc. I have a conference call with a bunch of Cannucks at 0930 CDT for about 45 min. After we can talk if you call me. Oh, sorry, forgot you were up North...
Hope it helps,
Robert
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Best Software to Track when a link I have Submitted goes live
Let's say I built a directory link and it takes a while to go live. Is there a tool that will crawl the site and notify me when the link goes live?
Link Building | | Firestarter-SEO0 -
Best way to check/find lost links?
Hi all As everyone, we have seen a decrease of domain authority and external links during the last months. with open site Rand is explaining the reason in this in this post, but I still would like to have a look to the links that in theory I have lost during the last months. I thought Majestic was the best option but I have been trying to get the info and I see nothing clear. When I download the fresh or history links, I only see links that are live (in theory, because in history I get a lot not existing but I can not see it without a manual check). The option of lost links is just giving me 1000 links per day, but after downloading some and checking I see that this lost link report is showing me links that are working (but it looks that majestic couldn't access when they did the crawling and show them as lost). Also the numbers of lost links are totally different if you use fresh or historic... Anyone could recommend me a good way to find out links that I really lost? Thanks
Link Building | | AutoEurope1 -
A website with a spam score of 5 is back linking to me. How important is to get that link removed?
There is a website that OSE has identified with a spam score of 5, it back links to me with a very specific key word. How important is it to have them remove those links?
Link Building | | absoauto0 -
Link Value
My question is how valuable is getting a link from a PA 71 with roughly 20 links on it. I guess I am saying how many links from a PA of 30 would be a comparable indicator. I understand there is an almost exponential value of authority as they go higher, but I am looking for a good explanation from a technical aspect. Hypothetical Scenario Would a person be better off pursing 20 links from PA25 pages, or would you be better only getting 1 from the PA71 all things equal.
Link Building | | mbarden260 -
Any benefits to having Wikipedia links now they are 'no-followed' (apart from traffic and natural link prof.)
I see that Wikipedia outbound links are all no-followed, is there any benefit (aside from the traffic) for having links here now ? For example is their co-citation and co-occurance benefits. I know there is without the links since from seeing previous Moz content about this saying Google getting good at connecting brand/s and topic mentions on a page (without any links) so appreciate Wikipedia is still good for that sort of thing. And a no-followed link is obviously good for the potential traffic. But is there any additional SEO benefit to having a no followed link on a wikipedia entry/stub too ? (aside from its contribution to your no-followed links which in turn contribute to a natural looking link profile) Cheers Dan
Link Building | | Dan-Lawrence0 -
Which tool is best for analyzing link prospect urls
Hi Mozers, I am currently looking for the best tool for analyzing bulk urls which are potential link prospects. I would like information on seo quality metrics like rel=nofollow etc. Your advise is much valued. Thanks, Fuad
Link Building | | Fuad_YK0 -
Adding NOFOLLOW to all external links, is this a good idea?
In the setting of a news site, with articles that often link to one or more outside sources, is it a good idea to rel="nofollow" all external links? Would this hurt link-building prospects? Of course, internal links would keep on passing link juice back and forth, but is there real harm in following external links? These would be links our writers and editors created themselves to reputable sources, blogs, etc.
Link Building | | VoxxiVoxxi0 -
Links in the Classifieds
We rent apartments. One way we use to find clients is to advertize these apartments in Classifieds. Generally, we use free ads. Sometimes, for very popular sites ( like Kijiji), we pay so our ads can be seen first. Could this be a problem with Google? Some sites send us clients, many of them never do. We keep putting ads there because of their PR. What is the worth of this kind of links? Thanks for your answers.
Link Building | | Caru0