Discrepancy between OSE internal links and Webmaster Tools
-
Hi,
We have been attempting to increase our rankings for our key term for a number of months now, and we are seeing an unusual discrepancy between OSE and Webmaster Tools that we believe may be causing us harm.
OSE shows our homepage, www.unionroom.com, as having only 27 internal links (only three of these aren't 301's too), whereas Webmaster Tools is showing just over 1,500 internal links to the homepage.
The three pages that OSE are displaying as linking back to the homepage are the homepage, our blog and our accessibility page. These pages are all ran off the same template and have the same header and footer (with three home links spread across header and footer). You can see our confusion!
Is this a case of OSE's stats being incorrect (the website has been live for ~6 months) or is there an issue with our in-linking structure that we are missing?
Thanks!
-
Yep that is correct, which can be 50/50.
-
Thanks for the link David, we will take a look through that.
I've quickly looked at some competitor websites and their home links are all href="/", so would I be correct in assuming that it if this affected our website it should also affect others in OSE?
-
To provide more detail there is a relative link back to the homepage though href="/" which our crawler doesn't work well with so having the full absolute path is recommended.
Here is a great resource that goes more in-depth about the differences: http://www.coffeecup.com/help/articles/absolute-vs-relative-pathslinks/
-
I ran some inner pages through OSE (/work and /contact) and both look to be indexed.
It's weird that you say 'For example we do have /blog/ indexed but there isn't a link going back to the homepage as "www.unionroom.com"' as this is one of only two pages (blog and accessibility) showing that DO link back to unionroom.com.
In summary:
- All inner pages are crawled.
- All inner pages (that we have tested) are indexed.
- All of our pages use the same template.
- OSE is stating that only two inner pages link back to the homepage (blog and accessibility).
-
It's possible we may not have indexed those pages or they have a link back to www.unionroom.com within the source code. You can verify by putting those pages into OSE directly to see if they have been indexed and also verify the link is in the source code.
For example we do have /blog/ indexed but there isn't a link going back to the homepage as "www.unionroom.com"
-
The crawl looks to be working correctly, as in it is finding all of the pages and posts that we would expect (approximately 300). It looks to be solely an issue with the number of internal links that OSE is saying the page www.unionroom.com has (27).
All but two of our inner pages, aside from the blog and accessibility, aren't listed on our internal link report for the homepage. This includes top level pages like services, about, contact etc, all missing.
The templates that we use for the blog and accessibility pages are identical to to what we use for other inner pages, so it's unusual that the others aren't listed.
-
Anytime!
Website structure can play a part but also time timing of when sites are indexed. There can be various networking issues that can prevent our crawler and others from reaching certain pages. You can always run a crawl test to look for any possible errors which you will have time to correct before the next update: https://moz.com/researchtools/crawl-test
Also some pages may be blocked intentionally from robots.txt and no-follow tags.
-
Hi David,
Thanks for your reply.
I'm concerned that on the competitor websites that we are evaluating using OSE, their websites' internal links are displaying much higher numbers than ours (27 vs ~300) even though our websites are of similar size. Could this possibly highlight an issue with our website structure (i.e. crawlers are having an issue finding ways back to the homepage via inner pages, even though we have three on each page around the website), or is this a case of MOZ crawling perhaps showing incorrect statistics?
I'm trying to eliminate the possibility of OSE's statistics being incorrect before we attempt to change the structure of the website and begin testing etc.
Thanks!
-
Hi Jordan!
There are a lot of reasons you could be seeing these data discrepancies. If you're seeing more GWT errors, it could be because they have 'discovered links' through different means. Moz starts with your home page and uses recursive crawling to find pages on your site. We keep crawling until we stop finding unique links, or until we hit your page crawl limit. Bottom line, when we crawl your site your homepage is the only seed. We know that Google uses multiple seeds, so it could be possible Google is indexing more pages that way. In sum Google will never match up with OSE but it's good to use both along with other backlink tools to cover all your bases.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved learning about links...
Hello! I'm wanting to gain some insight about backlinks, and wondering why a client's digital ads don't count towards our external link count. We don't see the domain listed in the Linking Domains and were just curious. Any information would be appreciated as we're always trying to learn! Thanks!
Link Explorer | | Ebbeka0 -
Unsolved Large discrepancy in number of links using compare links tool
Hi there, I’m trying to understand the large discrepancy in number of links among websites. For instance, I am comparing landing pages among two different colleges. One college has over 7 million links, while the other has only 72,000 links. Meanwhile, these colleges are fairly comparable in terms of population and prestige. Could anyone help me understand why this metric is wide ranging, and how a college could have so many links? Specifically looking at total links, internal links, external links, and linking domains.
Link Explorer | | HanoverianHE0 -
Link Explorer Export
Does anyone know how to export more than 50 keywords at a time from Link Explorer? I'm trying to extract the keywords from a competitor domain to do some analysis/big data queries. I'm using the link Explorer but I can't see any way to export more than 50 keywords at a time! The total I can export seems to be around 100k but it's going to take a very long time if I've got to do 50 at a ago!
Link Explorer | | seoman100 -
How can I get links indexed in Just Discovered Links, or Open site Explorer? (Because it aint Bit.ly or Feedly!)
Dear Moz & Forum, I've been on a bit of a merry-go-round with one of my clients. He knows enough about SEO to ask questions, and one thing he likes is to see the links that we are building inside Open Site Explorer. Now, of course we know that it takes a while for links to show, but that was ok, because we could just plug the links that we've built into a bit.ly link and then they'd show under Just Discovered Links in Open Site Explorer, and then boom, we're happy. It stopped working some time ago, and after the support team were a little unstuck I sent a hopeful tweet to @randfish. Here is the response: https://twitter.com/randfish/status/788412272129347584 The advice to use Bit.Ly was removed swiftly after this! Oops! The current Guidance is here: https://moz.com/help/guides/research-tools/open-site-explorer/justdiscovered It says: Want to see your new link in the Just-Discovered Links tab? An easy way to start seeing your link in the Just-Discovered section is to have it shared on Twitter and available on Feedly link. Feedly stopped supporting their own link shortner a few years ago. Also, when you share a link from Feedly on twitter it is just the same as sharing a normal tweet, because it shares the standard URL for the site not a link to view on Feedly. Or, maybe these two statements are independant of one another and they should both be done separately? I've done that too! I've also added the feed to recommended feeds inside fresh web explorer and that didn't work either! So, Moz and Help team please help me! How can I get links I've built for clients into Just Discovered Links? Thank you!
Link Explorer | | stevestretton11 -
Open Site Explorer -> Just Discovered -> Internal Links: Only shown 1 url link per day
Hi, We have a page that have like 10-15 new content/pages per day.
Link Explorer | | Inspiringinterns
eg. domain.com/post-id-01/, omain.com/post-id-02/, omain.com/post-id-03/ etc
But somehow, under Just-Discovered, internal links only show 1 per day when it suppose to display like 10-15.
The layout for each pages is exact same except for the content changes and the url's ID changes. Our competitor on the other hand, they have like 5 new page per day, but somehow Moz shows their internal links as 25 per days. Each of their new url have 4 more prefix number.
Eg:
new-page-01?track=990
new-page-01?track=991
new-page-01?track=992 etc
The above example url is technically as 1 page if without the "?" affix. Whiles all our new pages/url have unique id, but Moz only show 1 a day. Please advise on how to get Moz to shows all the new pages in Just-Discovered (internal link). Thanks, Cam0 -
Learn how to reclaim links using Open Site Explorer: Get your Daily SEO Fix!
Hi there! We're excited to announce a new collection of video tutorials focused on tips and tricks with Moz tools--each in two minutes or less. We're calling this how-to series The Moz Daily SEO Fix, and over the next 30 days we will publish a new video every weekday. Our goal is to help you get the absolute most out of your Moz Pro subscription and learn new ways to accomplish your SEO objectives. In today's Daily SEO Fix, David explains how to use Open Site Explorer's top pages tab, as well as the filter for 4xx and 5xx errors to find the pages on your site with the most potential link equity that are broken and can be redirected. 301'ing these URLs to relevant pages on your site can give your rankings a serious boost. Watch The Moz Daily SEO Fix: How to Reclaim Links Using Open Site Explorer to learn how. To view more Daily SEO Fix videos, be sure to check out The Moz Daily SEO Fix playlist on YouTube.
Link Explorer | | kellyjcoop7 -
OSE Links CSV: Download Failed - Server Problem
I'm just trying to download our Links CSV from OSE and I keep getting "Failed - Server Problem" and I got a bad gateway page when I clicked the download link in the email. Is there a problem atm?
Link Explorer | | SanjidaKazi0 -
How to increase number of internal links
Hi all, Using Open Site Explorer and Moz, we're getting only 50 internal links and like to know why. Our site is an online store with a quite good DA (26, see attached files) comparing with competitors, and all pages are in sitemap since several months, and crawled by google. Assuming that we have more than 2000 products in our site, and more of 10000 crawled pages with a link to the home page, we can't understand how "Total internal links" returns only 50. How can we increase internal links? Perhaps we misunderstood the meaning of "Total internal links" in page metrics. What does this value exactly mean? Any help will be appreciated. Thanks in advance. wuud3Lu RRvn31p
Link Explorer | | citricamente0