Google search issue with exact domain
-
We had a site from Feb-2011 to Nov-2011 at the domain amcoexterminating.com. The site was pure HTML/CSS and the daily unique visitors steadily increased over that time. So all was fine.
We then moved the site to a CMS (Joomla) on Dec. 6th. From that day forward, the daily visitors went into the tank.
Before the move, if you typed "amcoexterminating.com" or "amco exterminating" into Google search, the site would be the first result (as you'd expect since those are the words that make up the actua domain). But we tried this yesterday and the site did not come up at all. NOT GOOD. It would work in Yahoo or Bing, but not in Google. So obviously, the problem with Google search directly affected the daily visitors.
We just checked Webmaster tools yesterday (yes, this should have been done sooner, lesson learned) and it said "Site has severe health issues - Important page blocked by robots.txt". It listed the "important" page URL and it was just a link to an image. Regardless, I wiped out the Joomla created robots.txt file and added a new one and made it just say...
User-agent: *Allow: /
About 14 hours later, after the new robots.txt file was recognized by Google, the "severe health" message went away. However if I search in Google for "amcoexterminating.com", it still doesn't show up and the client is concerned (as they should be).
Do you think the search engines just need more time to refresh? If so, once it refreshes, should the site show up first again right away?
Or is it possible the robots.txt file had nothing to do with the issue? If so, what other things could I check into that might cause Google search to not find a site even if you search for exact domain name?
Please share any and all things I should look into as I need to get this site showing in Google search again (as it was before moving to the CMS).
Thanks!
-
Sorry I never replied...It all looks good now.
-
Hi Rob,
How are things going on this site? Are your rankings back, or are you still looking for some help?
-
Yes thats all you needed to do.
it should come back, with ine a few weeks
-
Update: I found this code in my htaccess file...
Header set X-Robots-Tag "noindex, nofollow"
So I commented it out like so..
#Header set X-Robots-Tag "noindex, nofollow"
And resaved it.
I imagine this is all I needed to do. If you think I should have done something else, please let me know.
-
Thanks Robert, the answer to your two "Edit" questions is Yes (htaccess.txt was renamed to .htaccess and "seo friendly URLs" was selected as YES).
It makes sense that what Alan suspects is my main problem (i.e. there is a no-index, no-follow on the homepage) so I'm hoping he can point me in the right direction to correct it. If you know and see my reply before he does, please let me know
-
Thanks for the heads up on the canonical issues, will correct that.
As for this X-robots header, do you know where I can find that code to either change the no-index, no-follow to index, follow, or delete it completely? I tried to view what you said in IE, but when I click F12, the window that pops up doesn't have a "Networks" tab.
I am searching my site files for X-robots header and can't find this area, so if you could give me any insight on correcting this, I would be very appreciative. If that is the problem (and I trust that it is), I really gotta get it fixed ASAP
Side note you may not know: If I correct the X-robots header to be index, follow, should the site start showing up again in Google results immediately or could it take longer?
-
Rob, you have a problem. Or two.
First, somehow your images files are showing up and I believe this is causing a duplicate content issue. If I were to guess, I would say that you are new to joomla and may have set something up incorrectly. Without seeing your Joomla dashboard, it is hard to say exactly what is going on though.
When you do a Site:www.amcoexterminating.com or Site:amcoexterminating.com you get mostly images and pdfs. You also see excluded content and when you click on it you see the same.
The only site url that is not a pdf is http://www.amcoexterminating.com/images/ so Google is not seeing any other url. This is due to Robots.txt or bad site map, Joomla settings that control these, etc.
I wish I could be of more help, but without seeing what the settings are in the dashboard, I cannot find the issue (using firebug, etc.).
Best
Edit: Alan has some good info in his response. Also, in Joomla on the Global Configuration there is an SEO Settings near top on right. Within that is a selection for Use Apache mod_rewrite if you selected this did you rename htaccess.txt to .htaccess before you activated this?
Above it is a selection for search engine friendly urls, have you selected that? -
No I cant see one image blocked being the problem, you should not block images, js or css files that are used on pages that are not blocked, it is not a problem alone, but if there are any other signals of spam, then the fact that you hide these files is then seen as a suspicious signal.
I am not a fan of CMS, as they do not write clean code. I had a look at your site and found many problems. The worst is canonical issues, you home page rank is split between
http://www.amcoexterminating.com/index.php
http://www.amcoexterminating.com
http://amcoexterminating.com/index.php
http://amcoexterminating.comYou need to fix your canonical issues.
http://thatsit.com.au/seo/tutorials/how-to-fix-canonical-domain-name-issuesbut the reason you cant find your page in Google is you have a X-robots header of no-index, no-follow. You have a index, follow meta tag, but the header must be overruling it.
If you want to see this for yourself. in IE press F12, select the network tab and start capturing. Load your home page, then click on the home page url in the results and select response headers.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Will Google Judge Duplicate Content on Responsive Pages to be Keyword Spamming?
I have a website for my small business, and hope to improve the search results position for 5 landing pages. I recently modified my website to make it responsive (mobile friendly). I was not able to use Bootstrap; the layout of the pages is a bit unusual and doesn't lend itself to the options Bootstrap provides. Each landing page has 3 main div's - one for desktop, one for tablet, one for phone.
Web Design | | CurtisB
The text content displayed in each div is the same. Only one of the 3 div’s is visible; the user’s screen width determines which div is visible. When I wrote the HTML for the page, I didn't want each div to have identical text. I worried that
when Google indexed the page it would see the same text 3 times, and would conclude that keyword spamming was occurring. So I put the text in just one div. And when the page loads jQuery copies the text from the first div to the other two div's. But now I've learned that when Google indexes a page it looks at both the page that is served AND the page that is rendered. And in my case the page that is rendered - after it loads and the jQuery code is executed – contains duplicate text content in three div's. So perhaps my approach - having the served page contain just one div with text content – fails to help, because Google examines the rendered page, which has duplicate text content in three div's. Here is the layout of one landing page, as served by the server. 1000 words of text goes here. No text. jQuery will copy the text from div id="desktop" into here. No text. jQuery will copy the text from div id="desktop" into here. ===================================================================================== My question is: Will Google conclude that keyword spamming is occurring because of the duplicate content the rendered page contains, or will it realize that only one of the div's is visible at a time, and the duplicate content is there only to achieve a responsive design? Thank you!0 -
Directing a domain.com/BLOG to a different host
Hello,
Web Design | | SharonEKG
i cant seem to figure out how to approach this matter. we have a website and a domain setup in one place and we wanted to setup a blog for that website on a different hosting, what do i have to do to link between the two to make it so when a user type domain com /blog he will get to our blog that is hosted on a different hosting plan? with the blog hosting plan we received a temporary domain that does not expire but i have been told that if i redirect to that temporary domain it wont work correctly also, if we do manage to go through that process will accessing the blog will the URL show domain com/blog or will still show the temporary given domain? is my only option is buying a new domain and just link between the two? Thanks!0 -
Hiding content until user scrolls - Will Google penalize me?
I've used: "opacity:0;" to hide sections of my content, which are triggered to show (using Javascript) once the user scrolls over these sections. I remember reading a while back that Google essentially ignores content which is hidden from your page (it mentioned they don't index it, so it's close to impossible to rank for it). Is this still the case? Thanks, Sam
Web Design | | Sam.at.Moz0 -
Accordion Fold Ups Bad For Google
http://fandicoach.com/products Right now I have these accordion things on the website. Are they bad for google in terms of being an SEO best practice? I want to avoid doing anything black hat. Thanks!
Web Design | | OOMDODigital0 -
Does Google penalise for alot of advertising on your site?
I look after the search side of a decorating website on which we carry a large amount of advertising from external brands as that is our business model. Do you know if we would get penalised for having too much advertising - would it be deemed to affect the user experience? Many thanks for your help on this.
Web Design | | Pday0 -
Having your blog on an external domain, is this ok?
We have our website / ecomm cart with network solutions and they do not allow you to have a internal blog like www.islesurfboards.com/blog . So the only solution is to have the blog on a external domain www.islesurfboardsblog.com which we set up. Is this ok for seo purposes or are we gonna miss out on alot by doing this. Any help?
Web Design | | isle_surf0 -
Domain Analysis
Hi all, Thanks for taking time to view my first question. I've noticed quite a change in our domain analysis figures in the last month (we have dropped two points whilst a competitor has jumped up 7 points for domain authority) and wondered if this was unusual or not as I've only been a member for a couple of months and it seems to quite a leap for them!? Cubicle Centre Ltd (washroomcubicles.co.uk) from 35 to 33 and Venesta (venesta.co.uk) from 27 to 34 The main changes I can see are that our number of links for External Followed (EFL) / Total External (TEL) and Total Links (TL) has dropped considerably whilst their's have remained fairly constant: EFL from 439 to 242 TEL from 466 to 263 TL from 3686 to 2980 We have managed to hold a top three spot in Google for the search term 'toilet cubicles' (UK!) for quite a number of years now and I am concerned these figures may be the start of a fall / reduction in our search engine performance. If anybody could give me some feedback or maybe even take a peep at our website (http://www.washroomcubicles.co.uk/) and see if there are any major SEO issues which I need to address to improve on the stats above, it would be very much appreciated. Remember this is my first question so please go easy on me! Thanks in advance.
Web Design | | cubicle_Craig0 -
Sub domain or separate domain?
Hi Mozzers, I'm redesigning a property database, and wondered whether it would be better to put this on a sub domain of my site or to set up a completely separate domain? Back story: My core website is about lifestyle, holidays and property in France. It's very popular, and benefits massively from long tail search. It's a fairly strong, recognisable brand, so I assume any association the database has with the site would greatly benefit it... Maybe. My current property database on the other hand is very poor in terms of SEO/visibility, etc, so we're having the whole thing redesigned from scratch. For the database, is it better to set up a subdomain of my strong branded site, or set up a completely new domain targeting keywords in the URL? Cheers! Matt
Web Design | | Horizon0