OSE not picking up all internal links?
-
Hi! I've been checking a few pages in OSE. For example:
https://www.holidayhypermarket.co.uk/holidays/last-minute
This, according to the tool, has only 6 internal links. However, a Screaming Frog crawl picks up 700+, which is about right seeing as there is a link in the footer. What do you think could be behind the discrepancy?
-
Doubtful. Running a site:holidayhypermarket.co.uk search in Google returns 10,700 results, plus from the help documentation on OSE it says, "The second thing to keep in mind that the exported data will only include the top 25 pages per linking root domain," from: http://moz.com/help/guides/research-tools/open-site-explorer/top-pages-ose
So by design it's not really a tool that's trying to duplicate Google, rather make an actionable scaled down copy of what's going on.
-
Thanks. I guess my point though is if that OSE is struggling to find the links, could the search engines? These aren't buried links - they are easy to see on the page. It would be good to know if there is a glitch or if something else is going on.
-
I wouldn't use OSE as an onsite crawler. That's what a tool like Xenu Link Slueth or Screaming Frog is for.
-
Hi! I understand that OSE isn't 100% accurate, but I'm wondering if something else is going on. It picks up internal links for competitors fairly accurately. It would be good to know though why it isn't picking up the footer links - could the code be difficult to crawl etc? It may be hinting at a problem that I've missed.
-
OSE also clusters by domain, so for a given link you're not going to get near the 700+ which are internal. As a general practice OSE is great for getting at link diversity, goal setting, and seeing where the competition has gotten links in the past. It should give you plenty of ideas that way. Cheers!
-
OSE is not an end all be all for links. They only gather a certain number links and data.
You're already using screaming frog to get this data, so that should be accurate. You can also check Google Webmaster Tools, which has a section called "Internal Links".
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is OSE having problems?
The healthpage says it is operational but I'm getting a ton of 'There was an error getting your data' messages. First I thought, it just happens to smaller pages, since testing it with moz.com worked. But even pages like nbc.com give me this error. I tried logging out an in again and even swithcing browsers - without success. Anyone else having problems like this right now? Cheers, Chris
Link Explorer | | chrwald0 -
Inbound Links - How accurate or up-to-date is Open Site Explorer?
When I type my domain into OSE I get a list of linking domains. Most of them I have seen before and I know were active last year. However, when I click through, many of these links have been removed (which is what I wanted/requested) and some of the pages return 404. Google (via link:www.mydomain.com) doesn't show these links as active either. My question is why does OSE show them? Thanks
Link Explorer | | neilmac0 -
Why is Open Site Explorer Showing me Spammy Links That I Already Removed?
Every two months or so, I like to download the OSE list of all the backlinks passing equity to my site. I do this so I can see which spammy links I need to try and remove. However, I see that OSE is still showing me links that I already removed...Either A) the page that is being linked to is 404-ed B) the spammy website that was linking doesn't exist anymore or C) the spammy site still exists, but the link is GONE. Why is OSE still spidering these sites and links? Does that mean Google is still spidering these links? Should I disavow them to be safe? Thank you! P.S We are not experiencing any drastic drops in traffic or penalties at the moment.
Link Explorer | | TMI.com0 -
Learn how to use Open Site Explorer's Just-Discovered Links report to build links and manage your brand. Get your Daily SEO Fix!
The Just-Discovered Links report in Open Site Explorer helps you discover recently created links--within an hour of them being published. It's pretty nifty. In today's Daily SEO Fix, Nick shows you how to use the report to view who is linking to you, how they're doing it, and what they are saying so you can capitalize on link opportunities while they're still fresh plus, monitor and participate in the conversations happening about your brand. Watch our tutorial Using Open Site Explorer to Find Fresh Links and Manage Your Brand Online and get ready to dive in! This video is part of The Moz Daily SEO Fix tutorial series--Moz tool tips and tricks in under 2 minutes. To watch all of our videos so far, and to subscribe to future ones, make sure to visit the Daily SEO Fix channel on YouTube.
Link Explorer | | kellyjcoop3 -
Learn how to use Moz's Spam Score metric to identify high risk links. Get your Daily SEO Fix.
Almost every site has a few bad links pointing to it but risky links can have a negative impact on your search engine rankings. Watch The Moz Daily SEO Fix: How to Use Spam Score to Identify High Risk Links to learn how to spot those spammy links and what to do with them. And, if you have more questions about Spam Score, check out Rand’s blog post: "Spam Score: Moz’s New Metric to Measure Penalization Risk." This video is part of The Moz Daily SEO Fix tutorial series--Moz tool tips and tricks in under 2 minutes. To watch all of our videos so far, and to subscribe to future ones, make sure to visit the Daily SEO Fix channel on YouTube.
Link Explorer | | kellyjcoop3 -
What is the difference between a "Just Discovered" link and an "Established" link in OSE?
What is the difference between a "Just Discovered" link and an "Established" link in OSE? How long does it generally take for a just discovered link to migrate in to the established link section? Are there other parameters that need to be met before a link can be referred to as established? Sorry for all the questions in one post, but I've had the same "just discovered" links in OSE for quite some time and have yet to see them migrate over to the "established" link section. I was hoping that when these links become established that it would help improve my site DA. Can anyone shed any light on this issue or have any other comments? Thanks MOZ!
Link Explorer | | GalcoIndustrial1 -
Updating OSE data
Hello Moz, I was wondering if anyone knows how Moz goes about updating their OSE data? I've been doing some link building that past couple of weeks, and I notice that the number of "just discovered" links will update every time I gain a new link, however, the "Linking domains" number doesn't (or maybe, rarely) update. I've checked through the "Linking domains" list to see if the link is there, but none of the links I've just recently obtained have shown up under that metric. Does anyone have any insight on this or is anyone experiencing the same issue? Thanks for reading!
Link Explorer | | GalcoIndustrial1 -
Sidebar on OSE causing problems
For the last few days a sidebar has been showing up on OSE and as a result I cannot see the social information on URLs, can someone fix this?
Link Explorer | | Eavesy0