Duplicate Content? Designing new site, but all content got indexed on developer's sandbox
-
An ecommerce I'm helping is getting a complete redesign.
Their developer had a sandbox version of their new site for design & testing. Several thousand products were loaded into the sandbox site.
Then Google/Bing crawled and indexed the site (because developer didn't have a robots.txt), picking up and caching about 7,200 pages. There were even 2-3 orders placed on the sandbox site, so people were finding it.
So what happens now?
When the sandbox site is transferred to the final version on the proper domain, is there a duplicate content issue?
How can the developer fix this? -
That would seem to be reasonable, with the information you've given. Best of luck!
-
Thank you for the very clear response!
The sandbox is on a subdomain of the developer's website. ourSite.theirDevSite.com/sandbox/
Their robots.txt actually redirects to their main website (why? no idea).
But the developer should verify the subdomain sandbox site in GWT/BWT, then disallow everything with robots.txt (and stop redirecting it), then request the entire site to be removed. Anything I'm missing?
-
Is the sandbox on its own subdomain or own domain? If so, verify the site in Google/Bing webmaster tools (subdomains verify as their own site), put in a robots.txt excluding everything, then go and request URL removal of the entire site in the webmaster tools.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
"Design by" footerlinks of webdevelopment firms
Hi Guys, Since our company does a lot of web development jobs next to our SEO work, we came across the topic of the “Design by” or “Webdesign by” links that our competitors are placing in the footer of clients websites. When I did some backlink analysis of our competitors these links make up the biggest part of their backlink profile. That way, I think they are important for the promotion and SEO of web development companies. I would love to have your opinion about how to use these links for SEO 1. Side wide vs homepage I think there are two ways here, going for a link at the bottom of every page or just one link at the bottom of the homepage. When you look at exposure the most ideal situation would be a side wide link (more eyeballs). From a SEO standpoint this might cause trouble. 2. Follow vs nofollow I think this is a very interesting one since there seems to be a lot of different opinions about if this is advertisement or not. A normal banner in a sidebar would get the nofollow tag to match Google’s guidelines but what about this “designed by” link? I know few designers and “putting a stamp” on their work is pretty common and more likely viewed as something that they deserve then an act of commerce. Besides this discussion adding the nofollow tag could prevent any issues with side wide links but reduces any SEO benefits to zero. Another option is adding the nofollow tag to all the links expect the one on the homepage. 3. Anchor text and descriptive text Since anchor texts play a big role in SEO (and in detecting spam) I’m interested in your opinion about the use of anchor texts with such links. Just the company name or the web address sounds like a safe choice (especially with side wide links) but it’s pretty attempting to link words like “Webdesign” instead of the company name. Do you think it’s safe to use this, or any other keywords in 0,5,10,15,20,25% of the times? And do you think the descriptive text “Webdesign and SEO by” got any value (or causes potential risks) when added before the link? 4. Alternatives or extra link opportunities Here are some other options I found and thought about considering getting links from client websites. Asking, or earning a link in their first blogpost. Yjpiieee our website is online, thanks guys of company X. Links in the disclaimer or legal parts of the website. Link in the main content of the about us. Most likely in the bottom a little section about the credits of the design etc. Links on partner / friend / links pages of the website. I saw all of these links in the backlink profiles of our competitors. Last but not least, my current standpoint: At this moment we ask our clients if we may place a small text and link in the footer of their website next to the copyright claim. We use texts like “Webdesign and SEO by Web Whales”. With only our brand name as anchor text (to avoid penalties). It’s a side wide follow link. Side wide because we want the exposure and follow because we want the SEO benefit. We considered just making the homepage link follow, but this kind of feels like manipulation so we just went for all follow since this is pretty normal on the web. Beside that we celebrate new websites with our clients to increase the change getting mentioned on the first blog or partner page. Occasionally we ask them for links on these pages. What’s your opinion about this topic?
Web Design | | Bob_van_Biezen0 -
Managing website content/keywords for wordpress site
We are in the midst of redesigning our website and have been working with freelance blog/content writers to increase the unique content on our site. We are finding it increasingly difficult to manage the topics/keywords as we continue to expand. Googledrive and google spreadsheets have been our primary tools thus far. Can anyone recommend a good tool that would allow us to manage content and blog posts for our site?
Web Design | | Tom_Carc0 -
SSL, SEO, and Site Migration question
When migrating a site to a new url and one where the old url had no https and the new url will be full https does it matter if the 301 redirect points at http://thisisthenewsite.com ? Meaning, should the new site have the ssl / https up prior to redirecting the old site? Does it matter if you redirect the old site to http://thisisthenewsite.com or https://thisisthenewsite.com? Since the site will force to https anyway?
Web Design | | Atlanta-SMO0 -
New Google SERPS design - What's Changed?
Has anyone noticed any fall out from the recent redesign of SERP pages by Google? I noticed that there appears to be one less organic result "above the fold" now, so if you were possibly in third or fourth position maybe slight dip in traffic? Any noticeable shift in click through rate with the new bigger font? Also, has anyone noticed if the new design has caused any shift in best practices for on-page meta data like Title tag and description tag counts? I know the Title tag was previously driven by the pixel width of the title in Google SERPS, just curious if that has changed with this redesign.
Web Design | | IrvCo_Interactive0 -
Retina Design or NOT for e-commerce selling gifts
We are planning to relaunch our ecommerce site selling gifts on Magento EE . I want to know weather we should go for retina or not. My only concern is page loading. Any advise will be appreciated.
Web Design | | Jvalops0 -
How much does on-site duplicated content affect SERPs?
Hi, We've recently gotten into Moz, with our E-commerce websites, and discovered that it's crawler takes note of about 2500 pages which it thinks are the same (duplicated). We've now begun to completely rewrite every description of every product (including Meta Title/Description) so that this number may be reduced. Since this is the biggest issue Moz spots I'm wondering what the effect of fixing it will be on our position in the SERP (mainly Google). Does anybody have some stories or experience about this topic? Thanks in Advance! 🙂 Alexander
Web Design | | WebmasterAlex0 -
How many sites on one hosting account?
How many sites is safe to house on one hosting provider? I use BlueHost and they advertise unlimited domains, but I'm not sure what the negative side effects might be from hosting too many on one hosting service. If it matter at all, I'm using WordPress to build my sites. Pros and Cons?
Web Design | | leafndrop0 -
What's the best was to structure Product page information on my site?
Hi - I run a hobby related niche new / article / resource site (http://tinyurl.com/4eavaj4). One of the most critical components of the site is our product database. We don't actually sell anything directly - instead we monetize them by displaying relevant affiliate product feeds and price comparisons. However since the Panda update was implemented in February my traffic (particularly my long tail, product related traffic) has dropped off considerably. I had about a 20% drop in overall traffic, but have made up some of the ground in the past week. However I want to know once and for all how I should structure my product related information as I have a ton of great content that is ready to be published in this section but want to be sure I structure it the best possible way from a SEO standpoint. Here are a few different options I've come up with for displaying information about products on my site. For the purpose of these examples I am going to refer to all of the information that makes up my product pages collectively as "product profiles". Please let me know which is the best SEO wise (or if you have a better way of doing it let me know): - Option 1 - Current Method - Divide Content Sections into different pages / urls Example: http://tinyurl.com/4tpdlbl This is how the majority of my product profiles are currently structured. I did this to improve load times and to keep the total number of links per page down. In addition to the core product profile subpages: "Product Details","Compare Prices", **"**Product Review", "Hot Auctions", and "Checklists", I have the Checklists area further segmented by subset, each of which is on its own page that is only accessible through the main Checklists tab of the profile. - Option 2 - Everything on one url / page the old fashioned way, with everything available by scrolling vertically. This would make the page go on forever though. - Option 3 - Everything on one url / page, but visually segmented using css / javascript tabs. Example: http://tinyurl.com/4kqhauh I looked at the source code and all the page text is there, so it looks like it would be spider-able but you tell me. Or would another method of tabbing be better? My site is wordpress based so the functionality comes from a plugin. - Option 4 - Use post tabs that are technically all on the same page, but make each individual tab be accessible through its own suburl, all of which share the same core canonical url. Example: http://tinyurl.com/4bs9pjs Clicking on any of the individual tabs will result in something like ?postTabs=2 being appended to the core url. Example: http://tinyurl.com/4gvgufc Any input would be greatly appreciated asap! Thanks Mike
Web Design | | MikeATL0