Why is open site explorer not showing the top links that if found previously.
-
In previous months ago open site explorer listed many other sites linking to mine. I have checked those sites and they are still linking to my site. Why doesn't open site explorer list them?
-
I got this reply from help@seomoz.org:
Your request (#41376) has been answered! See the comment history below. If you're not quite done with this ticket yet and want to add a comment, please reply to this email and the ticket will open back up.
If you wrote us using an SEOmoz account email, you can also view your ticket here: http://seomoz.zendesk.com/tickets/41376
Aaron Wheeler, Oct-27 14:03 (PDT):
Hey Tom,
Thanks for reaching out about this, and I'm sorry you're not seeing your links in OSE. It sounds pretty frustrating, and totally understandably so. As you know, we have made some updates to our crawling for Linkscape - sadly, with a few hiccups. This is the first quarte including the new metrics, which is why you're suddenly seeing the changes. Our new crawler is built to be fresher, but it is going deeper into domains, and, unfortunately, not visiting as many domains. This is probably why links from those domains aren't getting indexed. Domains with a high mozRank are getting crawled deeper, but domains with middle to lower mozRanks are not getting crawled. Our top priority now is to get the domain diversity back up to or better than that of our last quarter updates (as was originally designed) so that we should have many more inbound links. If you're interested, here's a link to the blog post about the update's metrics (it sounds like you may have read this): http://www.seomoz.org/q/link-analysis (scroll down to Kate's answer).
Also, just to be completely transparent about the update, you may see “questionable” links with weird file extensions - this is due to the crawler reaching much deeper into sites where there are more download links. We are looking into fixing this bug as soon as we can so these won’t be counted as links.
I hope this helps explain the changes. We are so sorry about the inconvenience and are focusing our efforts right now on getting this fixed! I wish there was more I could do for you personally, but at the moment, it's a matter of waiting for the index to expand. I've closed this ticket for now, but please let me know if you have any questions or if there's anything else I can do to help and the ticket will open right back up.
Have a great day,
Aaron--
Aaron Wheeler
SEOmoz Help Team
http://www.seomoz.org/team/aaron -
I've found the anchor text distribution not to be correct. It has stayed static on the last update mostly even though i have gotten rid of site-wide links.
I'll wait to see if the next update corrects it all.
-
Let me first share everyone, including myself and the SEOmoz team is unhappy with the tool's current performance. The information I am sharing is not designed to excuse anything but more so to share my understanding.
I found your link on the following page: http://www.business.com/general/carpet-cleaning-services/. The page shows a DA of 82 but a PA of 1. The PA of 1 indicates OSE is not seeing any links to the page which is not good.
The next area I took a look at is the site's internal linking. If I am on the home page of Business.com and I wish to find your listing in the way the crawler would (i.e. by following links) how would I do it? There is not a "general" category on the home page.
The only way I could navigate to your page is as follows:
-
Business.com home page select "Browse All Categories".
-
Scroll to the bottom of the categories page which has 370 links and select "C" from the Browse More Listings alphabetical selector
-
Select "Carpet Cleaning Services"
It's true your page is within 3 clicks of the home page, but it's a rough way to go. You could submit this example to the help team help@seomoz.org. They could perhaps offer more details about this particular link. I have seen pages on Yahoo Directory and DMOZ where even Google does not pick up the link.
-
-
These top links that were found in OSE before had been found for over a year after every crawl. Since July they have disappeared. I don't know why it wouldn't crawl Business.com.
-
why doesn't it remember the top links from before and check to see if they are still linking?
To the best of my knowledge, the Linkscape crawler begins with a clean slate each crawl. The database is emptied and the crawler is instructed to go out and crawl the top 25% of web pages. If you have links from quality sources such as the New York Times, Apple, Pepsi, SEOmoz, etc. then your links should be seen each time. If your links are from pages which are highly questionable, those pages may bounce in and out of the crawls at times for various reasons.
One example, a questionable site which is not crawled deeply ads a new article to their site. The article appears on the site's home page in the "new articles" block. That month the article is crawled because it is linked from the home page. Thereafter the article no longer appears with a link from the home page, the site is not crawled deep enough to find the article naturally, so the link is no longer visible. That is one common scenario which can occur.
-
Keri,
I know I have to change the content on a lot of the city pages. There are so many that I hadn't got around to them all. Creating new content for all those cities isn't easy.
Partners.html and Gotlinks.php are my links pages. Don't have much control on Gotlinks. Partners creates a 2nd page once it reaches more than 15 links and the title is then duplicated which I have no control. /lose_weight_fast I created myself which I do control to give myself links.
I see what you mean about keyword stuffing the URL's of the city pages but so far it has helped in Google except for Arlington_Virginia so I will probably shorten some of these and add it in my .htaccess file.
As far as the /blog well, all I get in my comments are spam so I did okay a few of these to let Google see some bloggers were interested in my site.
Thanks for pointing all these out. I will take care of most of it but the third party links mangers are a bit more challenging.
-
I'm still waiting on OSE to download the whole list to see if they are on there. First, be sure that you're looking at links that go to your entire root domain and not just to the home page. Second, not all of those are the best sites. The Wedding planning directory has hundreds of links, including links to adult incontinence products. That's not the top 25% of the web that OSE aims to index.
On a side note, are you aware of all of the pages on your site and spammy comments?
http://astrobrite.net/blog/?attachment_id=16&cpage=2#comment-51834
http://www.astrobrite.net/partners.html
http://www.astrobrite.net/Gotlinks.php
http://www.astrobrite.net/lose_weight_fast.htmlThere's a fair amount of cleanup you can do to your site that would probably help a lot. Right now, it gives off a bit of a spammy taste. Your URLs are keyword stuffed (astrobrite.net/Arlington_Virginia_Carpet_Cleaning_Arlington_VA_Carpet_Cleaners.html) and you've got a lot of spammy incoming links with pharma anchor text from forums. You've got nearly identical pages for different cities that are likely going to be filtered as duplicate content. The about us page has images that are very large, making for a slow load time.
You may be aware of some of these already, and I know they're not what you came for, but I did want to point them out just in case you had someone build your site for you and you didn't realize what was going on.
-
Okay, my website is www.astrobrite.net . Why did OSE find the following top links on and before 5/19/11 but now it doesn't list them even though they are still linking to me???
http://www.lakerealty.com , http://www.business.com/ , http://twitter.com/Astrobrite , http://www.webring.org/cgi-bin/webring?ring=novamembers;id=32;skip , http://www.house-cleaning-services.com/house_cleaning_VA.htm , http://www.weddingplanningdirectory.com/reciprocal.html
That is just a handful. There are more that it is not listing. My "Page auth" went from 62 to 57 and "Domain auth" went from 55 to 49. I had 6,008 Total links and now OSE shows 4,565.
If you are going to say OSE is not crawling right, why doesn't it remember the top links from before and check to see if they are still linking?
-
Here's information about OSE's latest update, form Rand's blog post. http://www.seomoz.org/blog/november-2011-linkscape-update
Are you seeing the links or are they still missing? If they're still missing, do contact help@seomoz.org.
-
Paul, what are you seeing (or not seeing) to lead you to that conclusion?
To the best of my understanding, Linkscape data processing was completed and updated yesterday and OSE was updated yesterday as well.
-
OSE doesn't seem to be updated with the linkscape update?
-
Rand will also be coming out with a post soon that talks about the latest update and what types of changes users will see. Do keep in mind that OSE only crawls about the top 25% of the web, and that crawl does change from crawl to crawl.
-
OSE was just updated yesterday. I can see the same issue you share throughout my sites. The SEOmoz site had a DA of 88 yesterday, but today it shows as 85. I noticed all my sites went down.
I know there have been some recent issues with OSE and there were adjustments made to this latest crawl. My best guess is the crawl did not go as deep as past crawls and so some links which were previously visible cannot be seen. Normally Linkscape crawls the top 25% of web pages.
I would suggest contacting help@seomoz.org and share specific examples of links which were previously visible but cannot be seen in the latest update. Those examples can help the team determine the root cause of the problem.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Domain still not being found in search
Hi guys, I've been handed a client who needs some seo work. I've tweaked one of their pages to focus on a chosen keywords about 4 months back but still the site is not even visible using the new Domain Analysis tool from moz and it still won't rank at all for the keywords. Am I missing something here? Is there something blocking the SERP from listing the website? I've ran a site: search on Google and it returns 283 results on the website. It's puzzling me as there clearly is something stopping it from being ranked. The domain name in question is: https://cloud9inecommunications.co.uk Thanks in advance.
Moz Pro | | Easigrass1 -
Why does Moz show 302s that I previously resolved?
So Moz was flagging thousands of 302 errors in the Redirect Issues section. It was due to the URL extensions containing /directory/currency/switch/currency/ I added this to my Robots.txt file as I don't want these indexed. I marked the 302 errors as fixed and after the next crawl they came back and I now get the message: One or more previously fixed issues continue to persist. We have found one or more issues that were marked as fixed previously in the last crawl. Do I just ignore the errors or is there something wrong that I may be doing? Any help would be much appreciated. Thank you.
Moz Pro | | lbagley0 -
Moz shows an F grade and 0 keywords on a previously high ranking page - Please help
Hi all, Moz is showing an F grade and 0 keywords across all URL, Title, Meta, H1, Meta and IMG ALT. My page has also dropped from 1st page rankings for numerous pages to 2nd and 3rd page. The page I am talking about is: http://year13.com.au/10-highest-paying-jobs-you-can-get-without-a-degree/ The keywords/phrases we were previously ranking very well for are: High paying jobs in Australia High paying jobs Highest paying jobs you can get with no degree Etc Etc I have also seen reduction in rankings on other keywords/ pages as well. Does anyone know why this might have happened? And what might be happening? Thanks in advance!
Moz Pro | | Stubs0 -
Number of available links limited?
OK, I've been making use of the free LinkScape API (on behalf of a client of mine) and trying to get links (and info on those links) to a specific domain/page/etc. NOTE : I've been using it without any issue in the past, however we are currently facing some weird issues. Let's take this simple query as an example : http://lsapi.seomoz.com/linkscape/links/wikipedia.org?SourceCols=4&TargetCols=4&Sort=page_authority&Scope=page_to_domain What this one supposedly does is to get links to "wikipedia.org", right? I'm reading : The Page_to_* scopes will by default return 25 links per source domain if no limit is specified, so you can see domain diversity. Due to space limitations in our API, a general link query for a given page will return at most 25 pages for every unique domain linking to that page. And I'm saying OK, that's fine. The thing is that (instead of the 1000 links I had been getting before), I'm now getting just 25 links. NOT per... "source domain"... but obviously per "target domain" (= wikipedia.org) - or am I missing something? (well, probably wikipedia suddenly has just about 25 links pointed to it... makes sense! 🙂 ) Please, let me know what's going on with the above, simply because getting just 25 links is close to worthless... Thanks a lot, in advance!
Moz Pro | | drkameleon0 -
Why site is getting ranked in top three positions on Bing and Yahoo but not in Google?
My site Business-Training-Schools.com is getting descent traffic from Bing and Yahoo but very little from Google. Can you please help me in finding out the root cause of it?
Moz Pro | | HQP0 -
HTTPS In Open Site Explorer
Hey All I was hoping a friendly mozzer might help me out, heard they're hard to track down though 🙂 I see OSE automatically has the http:// for the URL you enter. Anyway to tell if an https:// version of a page has backlinks coming into it with OSE? Thanks! -Dan
Moz Pro | | evolvingSEO0 -
Is Open Site Explorer ignoring 301 redirects now?
I just recently saw a huge decline in the page rank of a specific page on my site. When I investigated a bit further I noticed that the drop in page rank looks like it is due to the fact that most of the links to the page come through 301 re-directs from an old page. I know you just made a change to Open Site Explorer. Did you change the way that you are treating 301 re-directs? Here is the new page: http://www.justjen.com/shop/big-sister-tshirts.htm Here is the old page: http://www.justjen.com/shop/bigsister-tshirts.htm Up until the last couple of days, the new page was showing the links from the old page in your cache, but as of today, the new page is only showing the links that go to it, not the links to the old page that is re-directed to it. If there was a change recently, was this intentional (trying to replicate the search engines better) or is it an oversight or database anomaly?
Moz Pro | | gametv0 -
Links from External Sites not Showing on OpenSite or Google Webmaster Tools
Hi, I asked this in another post, but didn't get a solid answer. For several websites I manage, I have access to their Google Webmaster Tools. When I put the site through there, or the link:// or SEOMoz's OpenSite link reporter, I get not even a fraction of the links that I know are pointing to the websites in question. Some of these links are from home pages or side columns, and some are from articles keep within a website, like at Inc.com. I wondered if the links in question were not themselves being indexed, but if I do a very specific search, I can pull them up in the search results. Is it just common knowledge that these link tools are not accurate? And to assume that somehow, search engines really do see all of the inbound links, even if our reporting tools don't. Thanks in advance!
Moz Pro | | lilactree0