Development site accidentally got indexed and now appears in SERPs. How to fix?
-
I work at a design firm, and we just redesigned a website for a client. When it came time for the coding, we initially built a development site to work out all the kinks before going live. Then we relaunched the actual site about a week ago.
Here's the problem: Somehow, the developer who coded the site for us (a freelancer) allowed the development site to be indexed by Google.
Now, when you enter the client's name into Google, the development site appears higher in the results pages than the real site! In fact, the real site isn't even in the top 50 search results. The client is understandably angry about this for multiple reasons.
We quickly added a robots.txt file to the development site and a 301 redirect to the real site. However, that did seemed to have no effect on the problem.
Any ideas on how to fix this mess? Thank you in advance!
-
For the future, I'd suggest using something like Code Monitor (https://polepositionweb.com/roi/codemonitor/index.php) to monitor for any changes to your live or staging robots.txt. I've been in situations where too many people had access to the site that didn't know what they were doing, and getting an alert within 24 hours that someone changed something in robots.txt really saved us.
-
This exact same thing happened to me. I wasn't aware of the remove URL tool that others have suggested, so if it helps I'll tell you what I did. I simply added a rel=canonical tag from the development site to the new one. Then, once the new one had regained its SERP I deleted the development site. That way, I was sure that the client's site would have good positions.
-
Both nailed it spot on. Thats the way to go.
-
Use Google Webmaster tools. Under Site Configuration > Crawler Access, there is a "Remove URL" tab that will allow you to request URLs be removed from Google's index.
-
Hi Matt
Through Google Webmaster Tools, you can request that the whole website (the development site) be removed from Google's index. Could speed up the removal process by doing so.
Regards
Simon
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Our client's site was owned by former employee who took over the site. What should be done? Is there a way to preserve all the SEO work?
A client had a member of the team leave on bad terms. This wasn't something that was conveyed to us at all, but recently it came up when the distraught former employee took control of the domain and locked everyone out. At first, this was assumed to be a hack, but eventually it was revealed that one of the company starters who unhappily left the team owned the domain all along and is now holding it hostage. Here's the breakdown: -Every page aside from the homepage is now gone and serving a 404 response code -The site is out of our control -The former employee is asking for a $1 million ransom to sell the domain back -The homepage is a "countdown clock" that isn't actively counting down, but claims that something exciting is happening in 3 days and lists a contact email. The question is how we can save the client's traffic through all this turmoil. Whether buying a similar domain and starting from square one and hoping we can later redirect the old site's pages after getting it back. Or maybe we have a legal claim here that we do not see even though the individual is now the owner of the site. Perhaps there's a way to redirect the now defunct pages to a new site somehow? Any ideas are greatly appreciated.
Technical SEO | | FPD_NYC0 -
Switching site from http to https. Should I do entire site?
Good morning, As many of you have read, Google seems to have confirmed that they will give a small boost to sites with SSL certificates this morning. So my question is, does that mean we have to switch our entire site to https? Even simple information pages and blog posts? Or will we get credit for the https boost as long as the sensitive parts of our site have it? Anybody know? Thanks in advance.
Technical SEO | | rayvensoft1 -
Homepage de-indexed, rest of site all there...
This is a random issue that I've been trying to get to the bottom of over the last few months. First I thought it might be that I have a spammy host, so I changed it. My site loads a little faster but the homepage is still totally non-visible. Other pages and posts index no problem.. It's really quite frustrating. http://bit.ly/1hA8DqV Any suggestions welcome. Standard WP, running Wordpress SEO by Joost and a few other basic plugins...
Technical SEO | | duncm0 -
Fixing up poorly performing eCommerce SIte with content? First things first..
I had a small site that was performing well enough for me for 6 years--nice source of extra family income. It was a very out of date platform (1990's) and I moved it to Big Commerce in December. Since then visits and sales have just plummeted. It has died and I am sad. I want to remain positive. It's a viable niche product line, I have tons of quality inventory, my site platform is current. I am a good writer and am willing to add content if it will help. From what I can determine apart from technical issues I may not know about I think I suffer from THIN CONTENT. I want to pretend I'm opening a new business and start over in today's environment. I have had bad experiences with two SEO consultants (one ripped me off financially, the other gave me advice that hurt me) so I have no choice but to educate myself. I got started in ecommerce back in 1998 with the help of many wonderful kind people on forums so I'm turning to this resource once again. What would you do first if you were me especially to get some revenue flowing asap? I need help. I need to know if there is hope or if I should liquidate at the nearest swap meet 😉 Thanks! decorativedishes.net
Technical SEO | | ddktt1 -
Poor Site Performance
Hello, A couple of months ago, this site was dropped from google due to a noindex, nofollow tag thewealthymind(dot)com It's back up, but performing poorly. Take for example the term "The 4 step belief change" in the home page title tag. This site is the #1 authority on that and yet it ranks 3rd below weaker pages. There's 180 404 errors in GWT, many from past versions of pages of the site but also including thewealthymind(dot)com/index.html and thewealthymind(dot)com/index.htm even though there is a rel=cononical tag on the home page. What's the process of getting this site back to health?
Technical SEO | | BobGW0 -
Indexing Issue
Hi, I am working on www.stjohnswaydentalpractice.co.uk Google only seems to be indexing two of the pages when i search site:www.stjohnswaydentalpractice.co.uk I have added the site to webmaster tools and created a new sitemap which is showing that it has only submitted two of the pages. Can anyone shed any light for why these pages are not being indexed? Thanks Faye
Technical SEO | | dentaldesign0 -
Have my site been penalised ?
Hi, I recently hired a link builder (who works for a digital marketing agency and wanted to earn some extra cash ) to do some link building for me on keyword Carpet Cleaner Hire Basically , May my ranking for this work has moved from 29 up to 13 , then down to 500 + and now up to 67 ?. It's been all over the place and I am worried that maybe google thinks its unnatural or to many links etc. I looked at some of the work this chap did and there was a log of bookmarks done , apparently to increase social awareness and some articles on random forums I never heard of but the articles didn't look to good and in my eyes were a little spammy.. I don't have any messages in WMT saying I have been penalised or anything but I am naturally worried that this chap may have caused damaged and that I was manually penalised. I have since asked him to stop immediately.. does this sound normal for the ranking to be all over the place in this manner when link building ? How can I tell if I have been manually penalized in any way ? What;s the general consensus ?. Should I contact google or leave it and see what happens ? Other keywords seems to be okay though. Any advice much appreciated. thanks Sarah.
Technical SEO | | SarahCollins1 -
Considering redirecting my site from .com/us to just .com. What could the possible SERP consequences?
Today we use country-specific .tlds but have the US site on .com/us; .com is now a 'flag-site.' Ikea uses that structure too (.com/.com/us). Looking potential risk to redirecting current US site to .com.
Technical SEO | | KnutDSvendsen0