Website not being indexed after relocation
-
I have a scenario where a 'draft' website was built using Google Sites, and published using a Google Sites sub domain. Consequently, the 'same' website was rebuilt and published on its own domain.
So effectively there were two sites, both more or less identical, with identical content.
The first website was thoroughly indexed by Google.
The second website has not been indexed at all - I am assuming for the obvious reasons ie. that Google is viewing it as an obvious rip-off of the first site / duplicate content etc.
I was reluctant to take down the first website until I had found an effective way to resolve this issue long-term => ensuring that in future Google would index the second 'proper' site.
A permanent 301 redirect was put forward as a solution - however, believe it or not, the Google Sites platform has no facility for implementing this.
For lack of an alternative solution I have gone ahead and taken down the first site. I understand that this may take some time to drop out of Google's index, however, and I am merely hoping that eventually the second site will be picked up in the index.
I would sincerely appreciate an advice or recommendations on the best course of action - if any! - I can take from here.
Many thanks!
Matt.
-
Nice catch, Lynn. That's got to be (at least the majority of) the problem.
-
Hi Matt,
It looks like you have no index headers being sent out on your site. if you have the web developers toolbar installed on firefox and view the response headers on your homepage you will see:
X-Robots-Tag: noindex, nofollow, nosnippet
So this is like a noindex, no follow meta tag and is basically blocking the search engines from spidering and indexing your site. If you find out where those headers are getting set and get rid of them you should see your site getting indexed pretty quickly.
-
Hi Matt,
Majestic, Open Site Explorer and ahrefs are all showing zero links pointing to the entire domain, waydownunder.com.au.
I'm not suggesting this proves that you don't have enough links for Google to crawl/index the site, as I have also repeatedly seen Google index sites that don't have links yet. However, if these three major link indexes are showing zero links, there's a good chance Google's not discovering the site through regularly crawling as well.
Have you tried creating and submitting a sitemap via Webmaster Tools?
Best,
Mike -
Thanks Lynn and Mike - really appreciate your feedback. What you've both said about duplicate content being a ranking rather than indexing issue certainly makes sense.
Unfortunately the old site is unable to be restored. On the other hand, regular links have been posted to the site through social media (facebook) as well as a blog site (which IS being indexed regularly).
So - this has me entirely stumped!!!! I just cannot see any reason why the site is not being indexed at all! The site has been live now for around 2 -3 months; and I've had other sites with far less content / active links etc etc being indexed in no time at all.
The website in question is www.waydownunder.com.au - if anyone had a minute to take a quick look and see if I've missed anything obvious, I would really really appreciate it.
Thanks kindly,
Matt.
-
Hi Matt,
I would echo Lynn's recommendations here.
I doubt Google is actively filtering the 2nd site from search results (the duplicate content filter is employed scarcely, you'll find no shortage of duplicated sites that are indexed - it's also more of a results filter than an index filter, meaning duplicate content is still indexed, it just isn't shown in SERPs when the filter is active).
It's more likely that you simply haven't sent Google a strong enough ping that the site is worth indexing. Generate some marketing activity around the site, link to it from the current site as Lynn suggested (esp. with turning those pages into summaries), and I expect the site will show up in the index within a couple of weeks.
Best of Luck,
Mike -
Hi Matt,
It can take some time to index new sites. Submitting a sitemap to GWT, building a couple of links and sharing it a bit on social channels will usually help speed up the process. I am not very familiar with google sites, but if you can re-enable the google hosted site then maybe it is an idea to announce there that the site is now hosted elsewhere and link to it. You could reduce the content on the google site pages to just an abstract/intro on each page and link to the full content which is now on the new site which should take care of duplicate content issues and also show a clear connection between the two of them (for both incoming users and search engines).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
MOZ is showing that I have non- indexed blog tag posts are they supposed to be nonindexed. My articles are indexed just not the blog tags that take you to other similar articles do I need to fix this or is it ok?
MOZ is showing that my blog post tags are not indexed my question is should they be indexed? my articles are indexed just not the tags that take you to posts that are similar. Do I need to fix this or not? Thank you
Intermediate & Advanced SEO | | Tyler58910 -
Why has my website been removed from Bing?
I have a website that has recently been removed from Bing's index, but can't figure out why. The website isn't new, and it is indexed just fine on Google. These are the steps I've tried: The website is verified in Bing Webmaster Tools and successfully submitted the sitemap. I tested the URL to ensure that Bingbot is allowed to crawl the site I submitted URLs to Bing via the URL Submission tool There isn't a "noindex" on the site preventing it from being indexed When I do a URL Inspection, an error message comes up saying "The inspected URL is known to Bing but has some issues which are preventing us from serving it to our users. We recommend you to follow Bing Webmaster Guidelines." I contacted Bing to ask whether the website was removed in error, but received a reply that the website doesn't comply with Bing's quality guidelines, but they wouldn't go into detail as to which guidelines the website isn't meeting. The website URL is https://www.pardeehospital.org. Can anyone offer any advice or insight as to why Bing won't index our site? Thank you!
Intermediate & Advanced SEO | | lindsey.steinkamp0 -
Development/Test Ecommerce Website Mistakenly Indexed
My question is - relatively speaking, how damaging to SEO is it to have BOTH your development/testing site and your live version indexed/crawled by Google and appearing in the SERPs? We just launched about a month ago, and made a change to the robots text on the development site without noticing ... which lead to it being indexed too.So now the ecommerce website is duplicated in Google ... each under different URLs of course (and on diff servers, DNS etc) We'll fix it right away ... and block crawlers to the development site. But again, may general question is what is the general damage to SEO ... if any ... created by this kind of mistake. My feeling is nothing significant
Intermediate & Advanced SEO | | estampe1230 -
"No Index, No Follow" or No Index, Follow" for URLs with Thin Content?
Greetings MOZ community: If I have a site with about 200 thin content pages that I want Google to remove from their index, should I set them to "No Index, No Follow" or to "No Index, Follow"? My SEO firm has advised me to set them to "No Index, Follow" but on a recent MOZ help forum post someone suggested "No Index, No Follow". The MOZ poster said that telling Google the content was should not be indexed but the links should be followed was inconstant and could get me into trouble. This make a lot of sense. What is proper form? As background, I think I have recently been hit with a Panda 4.0 penalty for thin content. I have several hundred URLs with less than 50 words and want them de-indexed. My site is a commercial real estate site and the listings apparently have too little content. Thanks, Alan
Intermediate & Advanced SEO | | Kingalan10 -
Dev Subdomain Pages Indexed - How to Remove
I own a website (domain.com) and used the subdomain "dev.domain.com" while adding a new section to the site (as a development link). I forgot to block the dev.domain.com in my robots file, and google indexed all of the dev pages (around 100 of them). I blocked the site (dev.domain.com) in robots, and then proceeded to just delete the entire subdomain altogether. It's been about a week now and I still see the subdomain pages indexed on Google. How do I get these pages removed from Google? Are they causing duplicate content/title issues, or does Google know that it's a development subdomain and it's just taking time for them to recognize that I deleted it already?
Intermediate & Advanced SEO | | WebServiceConsulting.com0 -
Are pages with a canonical tag indexed?
Hello here, here are my questions for you related to the canonical tag: 1. If I put online a new webpage with a canonical tag pointing to a different page, will this new page be indexed by Google and will I be able to find it in the index? 2. If instead I apply the canonical tag to a page already in the index, will this page be removed from the index? Thank you in advance for any insights! Fabrizio
Intermediate & Advanced SEO | | fablau0 -
My websites position has dropped, any ideas why?
Hi, First off im new here, so hello to everyone. Now to the reason why I have joined. I am currently trying to rank for 2 terms: **UK Bank Holidays 2013 (Term 1) **and Bank Holidays 2013 (Term 2) The page which im trying to rank these terms on is: http://www.followuk.co.uk/bank-holidays Now some background history: On the 29th Dec 2013, term 1 was 5th and term 2 was 7th - rankings achieved through guest blogging. Last night I changed the h1 tag from 'Bank Holidays 2013' to 'UK Bank Holidays 2013'. Re-worded the meta description to try and increase the CTR. And removed the term 'Bank Holiday' from the end of each sub-heading - Ex: 'New Year's Day Bank Holiday' to 'New Year's Day' - I did this because I felt it was to much so in total 'Bank Holiday' term had been removed from 5 sub-headings. Ok, so I went into WMT and resubmitted for indexing, over night the page got reindexed - the term 'UK Bank Holidays 2013' stayed at the same position (5) BUT the 'Bank Holidays 2013' term dropped into hell at roughly position 250. I'm thinking of changing everything back and crossing my fingers that term which dropped comes back BUT maybe im being to rash and it might jump back as the page stands. I did a grade test using SEOMOZ and both terms generate a grade of 'A'. Has anyone got any ideas? Sorry if the thread is a bit messy im currently crying all over the keyboard as im typing. Thanks
Intermediate & Advanced SEO | | followuk0 -
New Website.. From where to start with a SEO Plan ?
Hi.. We have got two SEO and link builders working here in the office, putting in efforts is not a problem. And we have been doing SEO for our websites since a long time and they all rank well. Since, I have signed up for SEOMOZ, which is the one stop with all the heavy duty SEO guys, so we would like to get some suggestions from the experts. Ok here is the question. We have launched a new website this week and we have got a new SEO client, whose website is 6 months old. 1. What should be a proper SEO plan for a new website ? Got any Plan PDF or Buleprint, which you can send me ? 2. For the client website , he is ranking on 4-7th pages for his 4 keywords. Whats should be the correct way or plan to start doing SEO for them and get them to the first page ? 3. I feel like, doing competitive analysis is lacking with us and we are not good at evaluating that step. Whats the bet way to do competitive analysis ? 4. We are looking to build more and more links to the website . Whats the best way to make links ? Got any SEOMoz Blog post link, which explain this better or any forum thread which has got the tricks for this ?
Intermediate & Advanced SEO | | qubesys0