Why would my site return an error when using Open Site Explorer to crawl it?
-
I have built several new sites over the last few months for others, but recently built a new one for myself. I have gone through most of the checklists from this site to address on-page SEO, and now I am looking at link building.
When using Open Site Explorer, I receive an error saying that no information about the URL is available, even when I add competitor sites.
Wondering if this is a common issue and if there is a convenient remedy?
thanks!
-
You can actually check back in a day or two. A little bird told me we have an index update coming out very soon (keep an eye on the blog, we always post there).
-
Thanks. My URL is only about 30 days old and I don't yet have any back links, though I will shortly. I'll just keep at it and focus on this and check again in a few weeks.
-
How new is your website ? Do you have any sites linking to you currently ? You might want to check under Google Webmaster Console or Majestic SEO to see if they are reporting any backlinks (if at all they exist). If not, I would just concentrate on building links and eventually OSE will find you.
-
The site is yet to be crawled by OSE. It is updated every month or so.
Please check the calendar for more details on next update.
https://seomoz.zendesk.com/entries/345964-linkscape-update-schedule
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
WEbsite cannot be crawled
I have received the following message from MOZ on a few of our websites now Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. I have spoken with our webmaster and they have advised the below: The Robots.txt file is definitely there on all pages and Google is able to crawl for these files. Moz however is having some difficulty with finding the files when there is a particular redirect in place. For example, the page currently redirects from threecounties.co.uk/ to https://www.threecounties.co.uk/ and when this happens, the Moz crawler cannot find the robots.txt on the first URL and this generates the reports you have been receiving. From what I understand, this is a flaw with the Moz software and not something that we could fix form our end. _Going forward, something we could do is remove these rewrite rules to www., but these are useful redirects and removing them would likely have SEO implications. _ Has anyone else had this issue and is there anything we can do to rectify, or should we leave as is?
Moz Pro | | threecounties0 -
ERROR: Too Many on-page links!
User wise, my product menu @LEDSupply.com is user friendly, but I'm concerned that it might be seen by crawlers as bad because of the TOO MANY ON-PAGE LINKS error I am getting in my moz crawl report. Is it really counting all the links in every drop-down menu? If so, is there are resource on how to fix it????
Moz Pro | | saultienut0 -
Does Open Site Explorer purposefully not crawl some sites?
I use both SEOmoz's Open Site Explorer and Web Master Tools to find backlinks when conducting link audits. WMT always finds more links than OSE; I understand Google's database is bigger. But what is interesting to me is that it seems that a large percentage of the links WMT finds that OSE does not are real crappy links that I don't want. That makes me wonder if SEOmoz decides not to crawl certain, low quality, sites? Just curious.
Moz Pro | | ILM_Marketing0 -
Open site explorer showing zero backlinks
My new website: http://www.thelifesciencesreport.com/ is showing zero backlinks in Internet Explorer and I know of dozens that have posted our links: to name a few: http://www.pharmainfo.net/merck-news/02/10/2012/platform-technologies-promise-big-payoffs-juan-sanchez http://www.ibtimes.com/articles/296320/20120210/pharmaceuticals-pharma-medicine-platform-technologies-neurobiology-parkinsons-disease.htm http://www.google.com/finance/company_news?q=NYSE:MRK#
Moz Pro | | StreetwiseReports
http://www.businessinsider.com/platform-technologies-promise-big-payoffs-juan-sanchez-2012-2 http://www.traderwise.com/content/platform-technologies-promise-big-payoffs-juan-sanchez http://silverspotprice.com/
http://www.ihavenet.com/merck.html http://www.wallstreetwindow.com/aggregator/categories/1 any reason this is happening?0 -
How long should the weekly crawl take
Mine started yesterday afternoon and it's now almost 11pm on Sunday. 30+ hours and still not finished (and no progress indicator). 438 pages quoted as being crawled. That's not normal - right? I have made a bunch of changes based on last weeks crawl so I have been eagerly waiting for this to finish But 30 hours?.... Thanks. Mark
Moz Pro | | MarkWill0 -
Open site explorer - Analysing competitors links
When using open site explorer to analyse my competitors links, when going through them, I would click them to have a look at them. Almost all of the ones I clicked on something started to download on my computer and would be a blank page or the tab would disappear when the download begun. What is this? Why have they done this? Is this bad practice? Thanks
Moz Pro | | CompleteOffice0 -
Backlinks using Open Site Explorer
Hey guys, So I was doing some backlink analysis for a client and was utilizing Open Site Explorer, which stated that I had roughly 2,111 External Followed Links. However, I can't seem to find a way to export all 2,111 backlinks. I wanted to make sure if the links I had acquired had been indexed and crawled, and picked up, but I can't seem to access the full list on a domain level, only on the subdomain level. Anybody have any suggestions or advice? Any would be helpful! Best, James
Moz Pro | | sixspokemedia0