Accidently blocked our site for an evening?
-
Yesterday at about 5pm I switched our site to a new server and accidentally blocked our site from google for the evening. our domain is posnation.com and we are ranked in the top 3 in almost all pos related keywords. When i got in this morning i realized the mistake and went to google web tools and noticed the site was blocked so i went to fetch as google bot and corrected that. Now the message says:
Check to see that your robots.txt is working as expected. (Any changes you make to the robots.txt content below will not be saved.)
robots.txt file Downloaded Status
http://www.posnation.com/robots.txt 1 hours ago 200 (Success)When you go to google and type "pos systems" we are still #2 so i assume all is still ok. My question is will this potentially hurt our rankings and should i be worried and is there anything else I can do.
-
If you have any sort of caching installed, you could try refreshing it and resubmitting the sitemap.
I checked your robots.txt file at http://tool.motoricerca.info/robots-checker.phtml and it flagged the allow line. I don't think that would cause a problem, but you could try removing the "Allow: /" line and see if that helps.
-
Hey Nick thanks for your response...i did the first part but the sitemap on resubmit of the sitemap.xmp it wont take due to this error
URL restricted by robots.txt
but my sitemap file is here http://posnation.com/sitemap.xml
and is not blocking it...any ideas on what to do next
-
No you're ok. It used to be that if your site went down for even a few hours and the spiders came around that you could get deindexed. Now I guess they understand that stuff happens and you have a pretty long grace period before you get deindexed thankfully.
Good suggestions by Nick, also you can increase the googlebot crawl rate on your site in GWMT to get Google to come around again quicker.
-
If it was just blocked overnight you should be OK. Site's do go down for extended periods of time occasionally and I would assume Google won't de-index based on a relatively short outage.
To be safe, or at least make yourself feel like you have done what you can - resubmit your xml sitemap in webmaster tools. Also go to the "Fetch as GoogleBot" section and fetch your home page. Once it is fetched, click on the submit link and tell it to submit the page and all linked pages. You are probably OK without doing that, but it couldn't hurt to resubmit.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How long does google takes to crawl a single site ?
lately i have been thinking , when a crawler visits an already visited site or indexed site, whats the duration of its scanning?
Algorithm Updates | | Sam09schulz0 -
Why does my site dissappeare from the top 50?
Hellow I am having some problems with my site www.kondomanija.si. It was ranked on the first page for my main KW kondomi (in www.google.si, Slovenia) but now it is not in the top 10 pages. And this has happened before, it drops out of the top 10 pages and in a cople of moths it is back for a short time (till it drops out again). It think the site has a week link profile... Could this be the reason? Does anybody know what is going on?
Algorithm Updates | | Spletnafuzija0 -
SEO having different effects for different sites
Hi, I hope this isn't a dumb question, but I was asked by a local company to have a look at their website and make any suggestions on how to strengthen and improve their rankings. After time spent researching their competitors, and analysing their own website I was able to determine that they are actually in a good position. The have a well structured site that follows the basic search rules, they add new relevant content regularly and are working on their social strategy. Most of their pages are rated A within Moz, and they spend a lot of time tweaking the site. When I presented this to them, they asked why there are sites that rank above them that don't seem to take as much care over their website. For example, one of their main competitors doesn't engage in any social networking, and rarely adds content to their site. I was just wondering if anyone could shed any light on why this happens? I appreciate there's probably no simple answer, but it would be great to hear some different input. Many thanks
Algorithm Updates | | dantemple880 -
Does Site Size Influence Rank?
The Scenario:
Algorithm Updates | | kchandler
Currently one of my clients has 7-8 products that they sell on their website. For each product they have two different pages one with the product info and one with a video demo. So the pages began to split their authority as they began receiving new links. Since only one of the two pages for each product rank i suggested that we combine the two and redirect the video page to the product page to increases it's authority and rank. The Clients Response:
After explaining my reasoning and next steps the client mentioned that he thought a site's size was a ranking factor. I had never heard of this before so i told them i would do some research to prove my point, after a little digging around i am now even more confused. http://www.seroundtable.com/google-size-ranking-17044.html http://www.webmasterworld.com/google/4591155.htm The Question:
Does a websites size/amount of content indexed in Google actually effect your sites ability to rank? I look forward to everyones feedback, thanks Kyle1 -
Ranking well for main key terms but site traffic has dropped sharply?
Hello All, Just a quick question. Since the penguin update our site www.caravanguard.co.uk has seen some pretty fluctuating movement in Google, many of our key terms dropped over night, but over the last few weeks they have slowly started to move back up the rankings. The bizarre thing is despite the recover in rankings our unique traffic has taken a fairly large whack in numbers. Seasonality? Weather? ( it's been nice in the UK for a change) I can only assume the longer tail terms are taking more time to recover. I have tried to look into our back link profile and have noticed a little too much in terms concise keyword targeting, How do you go about changing these terms and removing the really bad links (struggling to identify the worst cases) on totally irrelevant sites or poor directories. Put in place before I started here 🐵 Any help truly appreciated. Regards Tim
Algorithm Updates | | TimHolmes0 -
How to speed up indexing of my site...
Only 4 out of the 12 pages of my blog/site have been indexed. How can I ensure all the pages get indexed? I'm using a wordpress site, and I also wondered how could I speed the indexing process up (I have submitted a site map) Thanks!
Algorithm Updates | | copywritingbuzz0 -
Is there a utility that can tell me what keywords my site already ranks high for?
Ok... so I'm looking for a way to understand what my site already ranks high for.. I don't necessarily want to have to manually type in keywords. The purpose of this exercise is to demonstrate to a client what keywords they're already ranking high for. Is there an easy way / tool to go about doing this? Thanks in advance, Gene
Algorithm Updates | | BGroup0 -
Data on Google Vs Bing, et al and changes to sites.
I am curious to know if anyone has any data that correlates site/page changes like content or Title Tag, H1, etc. and subsequent movement in rankings on Google and Bing and Yahoo? The equation is for example: ABCSite.com/home-page/ makes a change to the H1 and H2 and one paragraph of content is changed. Over next 6 to 12 weeks changes in page rank for the 3 engines is tracked to see where it started and where it "stopped." Obviously, there are more factors than individual algorithms in play here. An example of that would be that a significant number of sites will be indexed in Google by a dev and not in the others. We see this regularly. So, at least from a timing standpoint, different sites are entering/leaving the fray at different rates. We are going to begin to track this but I would love to see any data already around or speak with anyone involved in such a study about what they found. Thanks
Algorithm Updates | | RobertFisher0