OSE not picking up all internal links?
-
Hi! I've been checking a few pages in OSE. For example:
https://www.holidayhypermarket.co.uk/holidays/last-minute
This, according to the tool, has only 6 internal links. However, a Screaming Frog crawl picks up 700+, which is about right seeing as there is a link in the footer. What do you think could be behind the discrepancy?
-
Doubtful. Running a site:holidayhypermarket.co.uk search in Google returns 10,700 results, plus from the help documentation on OSE it says, "The second thing to keep in mind that the exported data will only include the top 25 pages per linking root domain," from: http://moz.com/help/guides/research-tools/open-site-explorer/top-pages-ose
So by design it's not really a tool that's trying to duplicate Google, rather make an actionable scaled down copy of what's going on.
-
Thanks. I guess my point though is if that OSE is struggling to find the links, could the search engines? These aren't buried links - they are easy to see on the page. It would be good to know if there is a glitch or if something else is going on.
-
I wouldn't use OSE as an onsite crawler. That's what a tool like Xenu Link Slueth or Screaming Frog is for.
-
Hi! I understand that OSE isn't 100% accurate, but I'm wondering if something else is going on. It picks up internal links for competitors fairly accurately. It would be good to know though why it isn't picking up the footer links - could the code be difficult to crawl etc? It may be hinting at a problem that I've missed.
-
OSE also clusters by domain, so for a given link you're not going to get near the 700+ which are internal. As a general practice OSE is great for getting at link diversity, goal setting, and seeing where the competition has gotten links in the past. It should give you plenty of ideas that way. Cheers!
-
OSE is not an end all be all for links. They only gather a certain number links and data.
You're already using screaming frog to get this data, so that should be accurate. You can also check Google Webmaster Tools, which has a section called "Internal Links".
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How can i download all inbound links.
Currently i can only download 50K links, but we have around 350K links, how can i download all the inbound links.
Link Explorer | | ITWEBTEAM0 -
Moz Spam Score 9/17 when there are no links
Hi I was just looking at a competitors new site in OSE and it had a DA and PA of 1 which I would expect and also no links, which again I would expect, basically the guy used to design stuff for me and thinks he can do a better job so he is giving it ago. But he has a spam score of 9/17 but no links - how is this even possible. Thanks Andy
Link Explorer | | Andy-Halliday0 -
Why is OSE showing a higher Domain Authority than Moz?
Moz has today run monthly reports for 2 of my clients' sites. For both of these, the Domain Authority reported on the Moz dashboard is several points lower than that shown by OSE today for the same sites. Why would that be?
Link Explorer | | mfrgolfgti0 -
Attaining DA, PA and Links Count
It's been more than 6 months since my site has been up. I have submitted the site to several online directories. However, I still cant attain a PA and DA. The link count is also not showing. Can someone please help to explain. The site URL is www.toymana.com
Link Explorer | | kookabara0 -
Why are no-follow links in my blog comments across the web showing up as "equity-passing"?
When I make comments on blog posts (and there's a link in my comment or my name is the link to my site), the links are always no-follow (as they should be). But, when I check Open Site Explorer, the new links show up as equity-passing. Are they actually passing equity or is this a mistake?
Link Explorer | | infotrust20 -
Why won't Open Site Explorer detect inbound links from big name websites?
I understand smaller, spammy sites woudn't get indexed, but some of the websites linking to mine have high domain authorities. The website is a parked subdomain.
Link Explorer | | myers3680 -
Inbound links export report link redirect to OSE
Hi there, I have received email notification that my new inbound links CSV report is ready to export and download. I follow the OSE link but I am redirected straight back to the main page of OSE not the download. Is there a problem? Are the access problems due to the Moz.com and Research Tools Outage. reported on Moz Health? David
Link Explorer | | David-E-Carey0 -
Is there an efficient way to use Open Site Explorer to find unnatural or harmful links
We have a new client with 8 sites that we would like to 301 to a new site. However, before doing so we want to make sure that the backlinks are not unnatural or harmful in any way. Using open site explorer (other than just looking at exact anchor text vs brand anchor text ratio) is there a way to determine low quality inbound sites linking in? or any type of links google will find manipulative?
Link Explorer | | Bryan_Loconto0