OSE Too Slow
-
I have a client site that's been up since March. GWT reports over 60 linking domains, most of which are relevant and high quality, yet OSE has never shown more than eight
anyone else have similar experience?
-
I use Majestic in combination with OSE. The former is great for raw counts and fast discovery, the latter gives me generally more reliable data (in terms of links that still exist, come from relatively stable sources, etc) and better metrics/filters. I thought Eric Enge's comparison was quite good: http://www.stonetemple.com/majestic-seo-open-site-explorer-shootout/
-
Sounds great Rand, but until then, to show clients progress, I'm going to have to use one of those barebones list-of-links indices.
-
Hi Wayne (and other folks),
Sorry for my delayed response. I agree that this is a serious problem faced by our indices, and it's one we're working to solve. The main issue is how we make a web index. In order to get metrics and all the views that power OSE (as compared to more of the barebones list-of-links offered by some other web indices), we have a lengthy processing step.
This means we can crawl the web for a few weeks, then we need to process for a few weeks, and our processing time often puts us behind other indices in finding and displaying links.
We're working on a way to eliminate this issue, but I suspect it will take 6-9 months to get this in place. In the meantime, we're building a datacenter that can process links more quickly so we can hopefully get better (even if it's not perfect) in the meantime. Look for faster indexing by January/February of 2013, and then much faster discovery by summer.
-
I use Raven Tools which gets its link data from majestic. They are pretty decent. A bit behind but also more up to date than OSE in my experience.
-
Any chance of sharing some of your other sources?
-
Your best bet is to just use GWMT for links for now. I tend to use a variety of sources just to get a feel for what is being crawled. It is still good to check OSE, but I would not use that as your primary method if you have to give client reports or anything.
-
I get that OSE is trying to be discriminating and discount spammy non-relevant directory links but most of my links are good quality and highly relevant.
-
It is very poor with recognizing links quickly.
In this latest round of updates OSE finally recognized links that I got a year ago. But still is missing a ton of 1 way links that I got from attending a conference in June.
I have been building a lot of 1 way links through networking and yet my DA is going down?? and the links take forever to be picked up.
-
Vikas, I have high quality links from the government of Canada which have never appeared in the OSE index.
-
Yes I have the same issue. I believe this question should goto seomoz, I made links more than one month back still none of them showing up in OSE today after more than a month.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why are my month old links not showing in WMT or OSE?
Hey Everyone! I've been working hard on boosting my ranking after launching my new site 2 months ago. I realize that this process normally takes some time however I've come across a questions that I'm not sure I know that answer to... I had some really solid back links added about a month ago but nothing is showing up yet in WMT on them. When I run an OSE I don't see any links there (not even under newly discovered). Can someone please help with some insight on why they might now be showing. Is it just a time thing or should I be doing something different?Any insight will be very helpful. Thanks
Moz Pro | | MDesigns0 -
Website blocked by Robots.txt in OSE
When viewing my client's website in OSE under the Top Pages tab, it shows that ALL pages are blocked by Robots.txt. This is extremely concerning because Google Webmaster Tools is showing me that all pages are indexed and OK. No crawl errors, no messages, no nothing. I did a "site:website.com" in Google and all of the pages of the website returned. Any thoughts? Where is OSE picking up this signal? I cannot find a blocked robots tag in the code or anything.
Moz Pro | | ConnellyPartners0 -
Why don't Google+ URL's work in OSE?
Is there any reason why Google+ URLs does not work in OSE? Is it just that it is a secure URL or is there something bigger there? Why? Be cool to determine every website the person has been published on; especially if it is rel="author" verified. Jeff
Moz Pro | | WebBizIdeas1 -
Can we add sites to the crawl queue for OSE?
Is it possible to request that Open Site Explorer crawls a new URL on its next run? This tool is the first place I go to when working on a new site, and when there is "No Data Available" this is a little frustrating. I fully appreciate that this lack of data is usually a signal that the website is either very new or of low quality, however that if often the reason that I am brought in and would very much like to benchmark and provide initial analysis using this tool. It would make sense that OSE crawls the sites that Moz members are working on wouldnt it? Scott.
Moz Pro | | eseyo0 -
Crawl slow again
Once again the weekly crawl on my site is very slow. I have around 441 pages in the crawl and this has been running for over 12 hours. This last happened two weeks ago (ran for over 48 hours). Last week's crawl was much quicker (not sure exactly how long but guessing an hour or so). Is this a known issue and is there anything that can be done to unblock it? Weekends are the best time for me to assess and respond to changes I have made to my site so having this (small) crawl take most of the weekend is really quite problematic. Thanks. Mark
Moz Pro | | MarkWill0 -
Trying to boost Backlinks but OSE still shows same figures for past month
I often check Open site explorer to see if I increased in linking root domains to my site after getting some backlinks on it. I have a concern about the number it is displaying: How does this statistic get updated? If I spread backlinks on some sites do i have to do anything else like ping it so google can crawl it so OSE sees it and counts it towards my linking root domain statistic? Is this current figure OSE is reading from cache and giving me an outdated number? NNzAn.jpg
Moz Pro | | lafurniturestore0 -
Filtering OSE Results
Issue: When I export OSE Linking Pages results to .CSV, I'd like to filter only unique domains. It seems to me that there should be a way to do this with Excel, perhaps pivot table. Anyone have a quick solution for this? Alternatively, I can use Linking Domains, which gives all unique roots, but then i lose follow/nofollow filter. Thoughts?
Moz Pro | | Gyi0 -
Does OSE Anchor Text Distribution CSV include internal links or external only?
Quite often when I'm using OSE and perform a CSV export, it looks like the total inbound link count and many phrases come from internal links for the domain in question. I haven't had the time to try and figure this out and don't know exactly how to go about figuring it out. So the initial question is does OSE's anchor text distribution CSV include internal links or are they external only? And alternately, how do I test for this? I deal with sites that have tens or hundreds of thousands of pages and hundreds of thousands or millions of links...
Moz Pro | | AlanBleiweiss0