Test site is live on Google but it duplicates existing site...
-
Hello - my developer has just put a test site up on Google which duplicates my existing site (main url is www.mydomain.com and he's put it up on www.mydomain.com/test/ "...I’ve added /test/ to the disallowed urls in robots.txt" is how he put it.
So all the site URLs are content replicated and live on Google with /test/ added so he can block them in robots. In all other ways the test site duplicates all content, etc (until I get around to making some tweaks next week, that is).
Is this a bad idea or should I be OK. Last thing I want is a duplicate content or some other Google penalty just because I'm tweaking an existing website! Thanks in advance, Luke
-
Thanks Martijn - have done all I can to block Google indexing now - Web developer was under the impression he had done what was needed but SEO mindset always makes me delve deeper! Glad I did!
-
You could protect the /test/ directory with a username / password by using .htpasswd.
This will prevent Google crawling your site and saves you your Crawl Budget. Make sure you don't link to the test/protected pages.You can remove the /test/ from Google by requesting a removal in Google Webmaster Tools. Otherwise there is a possibility that users visit some pages in the /test/ dir and receive a 404 error when you finished the tweaks.
-
Thanks Schwaab - good suggestions there!
-
I would add some no index, no follow tags to all of those pages as well just to be safe. I've had Google index some stuff I've had blocked via my robots.txt in the past. Also, make sure if you update your sitemap that you don't accidentally include these test URLs.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I'm Pulling Hairs! - Duplicate Content Issue on 3 Sites
Hi, I'm an SEO intern trying to solve a duplicate content issue on three wine retailer sites. I have read up on the Moz Blog Posts and other helpful articles that were flooded with information on how to fix duplicate content. However, I have tried using canonical tags for duplicates and redirects for expiring pages on these sites and it hasn't fixed the duplicate content problem. My Moz report indicated that we have 1000s of duplicates content pages. I understand that it's a common problem among other e-commerce sites and the way we create landing pages and apply dynamic search results pages kind of conflicts with our SEO progress. Sometimes we'll create landing pages with the same URLs as an older landing page that expired. Unfortunately, I can't go around this problem since this is how customer marketing and recruitment manage their offers and landing pages. Would it be best to nofollow these expired pages or redirect them? Also I tried to use self-referencing canonical tags and canonical tags that point to the higher authority on search results pages and even though it worked for some pages on the site, it didn't work for a lot of the other search result pages. Is there something that we can do to these search result pages that will let google understand that these search results pages on our site are original pages? There are a lot of factors that I can't change and I'm kind of concerned that the three sites won't rank as well and also drive traffic that won't convert on the site. I understand that Google won't penalize your sites with duplicate content unless it's spammy. So If I can't fix these errors -- since the company I work conducts business where we won't ever run out of duplicate content -- Is it worth going on to other priorities in SEO like Keyword research, On/Off page optimization? Or should we really concentrate on fixing these technical issues before doing anything else? I'm curious to know what you think. Thanks!
Algorithm Updates | | drewstorys0 -
Google Algo Update
Hi I'm trying to look into how the update in Oct - Nov affected our site. It's positive with us ranking for more keywords, but I wondered if anyone knew what had changed. For example, one of our pages ranked for 291 keywords in October, now it ranks for 406 keywords. We've done nothing to this page in that time. I just want to try and understand what's happening with the algorithm a little more (although I'm sure everyone does :). Does anyone have any insights? Thanks!
Algorithm Updates | | BeckyKey0 -
A company claiming to have a proprietary software that replicates Google algorithm?
Hi all, Unfortunately, getting into a bit of a p*ssing match 😞 with a company trying to compete for the business of one of our clients and just wanted to some feedback from the community here. The company competing for the client's business claims to have spent $1 million to replicate Google's algorithm so they create a replica site (not sure I understand this) of the client site, then test and optimize on-page SEO changes in their software to determine whether the on-page changes are ideal. Sounds fishy to me. Thoughts?
Algorithm Updates | | RickyShockley0 -
January 10, 2017 - Intrusive interstitials Google Update
Hi all, As everyone is most likely aware, Google have recently announced that if a site has intrusive intersitals that push the main content below the fold, will be downgraded in the SERP's from January 10th. At the moment we have a range of international sites, .ca, .com.au, .co.uk, .fr etc - if a user from a UK IP goes to a .ca site - a country switcher dialog will appear. I am aware that this may affect our sites performance in mobile search when the update comes out - however, if we block Google from seeing this - will they still pick it up? Thanks.
Algorithm Updates | | Brett-S0 -
Is there a we to get Google to index our site quicker?
I have updated some pages on a website, is there a way to get Google to index the page quicker?
Algorithm Updates | | webguru20140 -
Does anyone have an idea of the benefits of Google Analytics Premium?
We've been having a discussion about the GA Premium service here in our office, trying to weigh up the pro's and con's... For the majority all it seems you gain access to is more support from google. We're trying to find out if that is the case or if you gain extra information, such as and insight into the search terms who must not be named. Of course i'm talking about the (Not Set) data... This section of data is ever increasing, yes i know we can access certain terms through webmasters but it was so much easier (in the good ol' days) when all the data was under one roof! Any thought opinions or even more questions would be greatly appreciated, i look forward to your responses. Anthony
Algorithm Updates | | Kal-SEO0 -
Site titles / descriptions change - Google Algo Change ?
Hello, During the weekend 4 of our sites automatically changed their search titles and descriptions at the same time.
Algorithm Updates | | lordish
They are not picking up the real pages: Title, Description. Our ranks are dropping because of this. can you please tell if it happened to you as well or if you recognize a problem here? sites:
http://www.robinhoodbingo.com
http://www.gossipbingo.com
http://www.moonbingo.com in the attached examples:
for the kws searched - the results show different titles and descriptions. results for these pages:
moon bingo - http://www.moonbingo.com
mobile bingo - http://www.robinhoodbingo.com/skin/mobile.php rhMzURw.png 2tRL5dZ.png0 -
Google Algo Update In Que. What consititues over optimization?
http://www.pcmag.com/article2/0,2817,2401732,00.asp According to this, Google is bringing the hammer down soon on another 10-20% of the search results. While we don't advocate keyword stuffing, exchanging links, or anything too risky I am still concerned. Do we know if the example "perfectly optimized page"; http://www.seomoz.org/blog/perfecting-keyword-targeting-on-page-optimization is now going to be penalty bait? Is this over stuffing? Also, how might this effect ecommerce sites in particular?
Algorithm Updates | | iAnalyst.com2