Specific external links
-
So...we have an A+ rating with the BBB and have for some time. We have a link from their page. We also use sites like pricegrabber and reseller rankings and have links from those.
What I can't figure out is why links from the BBB and Pricegrabber don't even show up in open site explorer but the reseller ratings links are everywhere. The BBB one is easily the oldest and the other two are roughly the same age (i.e. at least a couple years old.)
-
The Open Site Explorer indexed is completely refreshed every few weeks, and currently consists of 105 billion links. While that's quite a large data set and mostly comparable with other indexes in the space, it's still only a fraction of the links on the web and only a portion of the links Google undoubtedly knows about.
The way OSE finds links is that it prioritizes pages with lots of inbound links and links it found during previous crawls. Because BBB pages are often found deep-deep-deep under layers of navigation and usually don't have a lot of external links pointing to them, they aren't easy pages for crawlers to find on a regular basis. BBB has an especially difficult site architecture, and sadly this issue comes up a lot with that particular site
We're working on including more historical data in the index, so that even if we didn't crawl the link in the past two weeks, we'll still include it if we are reasonably confident it still exist. This will help alleviate some of these concerns.
The good news (or bad depending on how you look at it) is that while OSE doesn't show every link, it tends to show the majority of the most valuable links.
Regardless, thanks for the feedback and best of luck with your SEO.
-
I share your frustration in wanting to be able to track links in OSE. Someone at Moz told me a while back that OSE only reaches 20-25% of links out there. I've just come to tell myself that if I know the link exists then I don't need to see it in OSE.
-
I wonder if Moz understands and follows the Robots.txt file? I know at one point they never, back in the day when I used Moz most of my errors came from URL's which were hidden by robots which would not of caused errors for Google.
& what your saying Oren makes perfect sense if it's correct. Why would they want to crawl aggregated content.
-
Perhaps a Mozzer can verify this, but I remember someone saying they Moz doesn't crawl some big sites that aggregate lots of data (twitter, BBB, yelp, domain listings, etc. etc.) because of the size of their servers, and the likelihood that the user put it there themselves. They have smaller servers than say, Google or Bing.
-
Hi,
Firstly it could be that Open Site Explorer has not had time to pick them up, if it's years old then let's not forget the OSE manually crawls the internet and is not Google's crawler meaning there will be sections of the web which won't be crawled by Moz.
If it's old then there may be no links pointing to these pages which would not give OSE a reason to crawl them, certainly if it's years. Don't worry about it, a missing link on OSE is one less your competitors can find I had a similar issue with a few links from BOTW but in time it updated and works fine but Open Site Explorer is not flawless.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Inbound links not found on OSE
I have live inbound links for the site htp://vpnexpress.net, but OSE reports nothing found. How long does it usually take for them to index high PR site links? Thanks.
Moz Pro | | xvpn9020 -
Discrepancy between followed links. How do you explain this?
My external followed links over time have gone from 346 in late November to 402. Total external links have gone from 400 to 457. Followed linking root domains dropped from 125 to 102 (How do I find out why?). Total Linking Root Domains Over Time dropped from 152 to 126. Linking C-Blocks dropped from 124 to 42. How did I increase my links but drop the other stuff?
Moz Pro | | EcommerceSite0 -
Percentage of good links vs. bad
Hi Does anyone know the best way of determining good links from bad links using the SEO Moz tools? I bought some directory links to two or three pages on my site a few years back. The were all very obviously spammy because of the anchor text and I didn't have a high enough ratio of good links to counteract them. I read somewhere that if more than 10% of the links to a page have the same (or similar) anchor text, it's obvious that you're on the bad list.
Moz Pro | | nsjadmin0 -
My domain authority is 1, and I am not seeing any links to my site.
I know that there are links to my site, but nothing shows up. My website is www.mullinsgeoffrey.com. I have tried with and without the www. I am using wordpress for this site, but competitors are as well, and there authority seems fine. is there a hidden setting somewhere that is screwing things up?
Moz Pro | | mullinsgeoffrey0 -
What is more important, page authority or linking root domains?
I have 2 pages in my report that are identical: www.ferringway.com (more page authority......21 vs. 1) www.ferringway.com/index.php (more linking root domains...... 40 vs. 21) Which one should I delete or should I do something like a 301 redirect? Your help is greatly appreciated! Sheryl
Moz Pro | | TOMMarketingLtd.0 -
More than 100 links
Hi Everyone, I was trawling through You Tube and came across this video from Matt Cuts from Google about the 100 links limit being removed. http://www.youtube.com/watch?v=l6g5hoBYlf0&feature=relmfu I then logged into my SEO account as I remember a previous report we did for a competitor where they had quite a number of pages just over the 100 links, but only barely (They are highlighted in SEOmoz as a warning). Given that google has removed this number from their guidelines and it's clear that a few over 100 isn't as bad as it used to be, is it not about time this was changed or looked at again? Maybe even put ones like these under a new title such as recommendation rather that the alarmist Warning one unless it's ridiculously high? I wonder if the SEOmoz team can also find out a better range figure for it instead of the outdated 100? Regards Alan watch?v=l6g5hoBYlf0&feature=relmfu
Moz Pro | | ContactOnline0 -
Viewing links gained over time
Is there a way to see how the number of inbound links has changed over time for a campaign? It is hard to tell whether links are increasing for a campaign without historical data being stored so trends can be shown
Moz Pro | | MulberrySqCraig0 -
How do you track links over time?
I'm new to SEOmoz and I'm really enjoying the fact that I can track all my keywords in a single place and monitor the changes. Is there a way to do the same with no my links? I mean: I'm using Open Site Explorar to track my links, but I want to know my link building performance overtime. Is there a way to do this automatically with SEOmoz? In case of a negative answer, how do you track your links over time? Thanks in advance!
Moz Pro | | Nauweb0