Does Open Site Explorer purposefully not crawl some sites?
-
I use both SEOmoz's Open Site Explorer and Web Master Tools to find backlinks when conducting link audits. WMT always finds more links than OSE; I understand Google's database is bigger. But what is interesting to me is that it seems that a large percentage of the links WMT finds that OSE does not are real crappy links that I don't want. That makes me wonder if SEOmoz decides not to crawl certain, low quality, sites? Just curious.
-
If only we had Google's computer budget, or even their food budget, to throw into our server farm! We do realize that we can't cover everything and that for an audit you will need multiple tools. Keep in mind that Bing offers link information, even for sites you haven't verified in their Webmaster Tools.
-
Thanks for responding Keri. The fact that OSE crawls higher quality sites is great from a link building perspective. However, from a link audit perspective, which is so important these days, it does not give me the information I need to research poor quality links. This forces me to rely on multiple tools.
Thanks again!
Megan
-
We do try to crawl higher-quality sites and show some of the better, more meaningful links to you.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Open Site Explorer WAY Off in Terms of Link Profiles?
Hey, One of our websites is www.inspireeducation.net.au. I have noticed although tools like Raventools capture our links well, Open Site Explorer is doing a terrible job... For example the following page >>> http://www.inspireeducation.net.au/courses/training-and-assessment-courses/certificate-iv-in-training-and-assessment/ has many many more than 8 root domains linking, however Open Site Explorer only presents 8? We are finding the same problem for almost any page we review through Open Site. Does anyone have any idea why the numbers would be so out? The new links are NOT fresh links. Many are well-established (been there for years), and even many newer ones have been there for more that 60 days. I find the same thing when reviewing competitor sites.. is Open Site Explorer working properly at all at the moment?
Moz Pro | | love-seo-goodness0 -
Looking for Advice on SEO for Minimilistic Site
Hi everyone, I found this site and it looks like a great place for us to start, we have just opened the doors to our new website fenwaymedia thats a dot co dot uk. Now Ihave tried to maintain the most minimilistic design throughout but I believe with this comes certain drawbacks - - - - S E O which is why i am here. My thought were that I would draw my clients from the Web Design, web Marketing & Blog page which I will starting in 3 hours be constantly updating. but Im not sure Im doing the right thing. I am trying to target Edinburgh, Scotland although we would take work from anywhere, if anyone could spare us a moment, I would greatly appreciate any help, tips or comments that might help us attain some visibility. Thanks in advance and thanks for looking. Kind regards, Craig
Moz Pro | | fenwaymedia0 -
How do I force a crawl?
In the campaign overview it reads that 0 pages were crawled. Also got an email saying that a comprehensive audit will be done in 7 days. But the 'crawl in progress' wheel disappeared. I think it stopped, and I need to submit that report to substantiate buying the tool! How do I force a crawl?
Moz Pro | | ilhaam0 -
Campaign crawl re - schedule
Hello, On the last crawl of a website of mine, seomoz pointed out about 1500 errors (ouch!) on my site. I have made some corrections and i just want to see if they are at the right way but the next crawl is in a week. Is there any way so i can force a crawl before the scheduled date? Thanks!
Moz Pro | | Tz_Seo0 -
How often are open site explorer reports updated?
I collect the information contained in open site explorer reports and csv backlinks audits on the 15th of every month. I noticed that the numbers are unchanged from 9/15-10/15. How often are the reports typically updated?
Moz Pro | | seagreen0 -
Crawling a website with redirects
Hi, I started a campaign for a website which uses multiple redirects before showing the real content. in the crawling report only one page is crawled. Is there a way to let the crawler pass the redirects to get usefull reports? The website is www.cegeka.be Thank you
Moz Pro | | Cegeka0 -
The Site Explorer crawl shows errors for files/folders that do not exist.
I'm fairly certain there is ultimately something amiss on our server but the Site Explorer report on my website (www.kpmginstitutes.com) is showing thousands of folders that do not exist. Example: For my "About Us" page (www.kpmginstitutes.com/about-us.aspx), the report shows a link: www.kpmginstitutes.com/rss/industries/404-institute/404-institute/about-us.aspx. We do have "rss", "industries", "404-institute" folders but they are parallel in the architecture, not sequential as indicated in the error url. Has anyone else seen these types of error in your Site Explorer reports?
Moz Pro | | dturkington0