Website not being indexed after relocation
-
I have a scenario where a 'draft' website was built using Google Sites, and published using a Google Sites sub domain. Consequently, the 'same' website was rebuilt and published on its own domain.
So effectively there were two sites, both more or less identical, with identical content.
The first website was thoroughly indexed by Google.
The second website has not been indexed at all - I am assuming for the obvious reasons ie. that Google is viewing it as an obvious rip-off of the first site / duplicate content etc.
I was reluctant to take down the first website until I had found an effective way to resolve this issue long-term => ensuring that in future Google would index the second 'proper' site.
A permanent 301 redirect was put forward as a solution - however, believe it or not, the Google Sites platform has no facility for implementing this.
For lack of an alternative solution I have gone ahead and taken down the first site. I understand that this may take some time to drop out of Google's index, however, and I am merely hoping that eventually the second site will be picked up in the index.
I would sincerely appreciate an advice or recommendations on the best course of action - if any! - I can take from here.
Many thanks!
Matt.
-
Nice catch, Lynn. That's got to be (at least the majority of) the problem.
-
Hi Matt,
It looks like you have no index headers being sent out on your site. if you have the web developers toolbar installed on firefox and view the response headers on your homepage you will see:
X-Robots-Tag: noindex, nofollow, nosnippet
So this is like a noindex, no follow meta tag and is basically blocking the search engines from spidering and indexing your site. If you find out where those headers are getting set and get rid of them you should see your site getting indexed pretty quickly.
-
Hi Matt,
Majestic, Open Site Explorer and ahrefs are all showing zero links pointing to the entire domain, waydownunder.com.au.
I'm not suggesting this proves that you don't have enough links for Google to crawl/index the site, as I have also repeatedly seen Google index sites that don't have links yet. However, if these three major link indexes are showing zero links, there's a good chance Google's not discovering the site through regularly crawling as well.
Have you tried creating and submitting a sitemap via Webmaster Tools?
Best,
Mike -
Thanks Lynn and Mike - really appreciate your feedback. What you've both said about duplicate content being a ranking rather than indexing issue certainly makes sense.
Unfortunately the old site is unable to be restored. On the other hand, regular links have been posted to the site through social media (facebook) as well as a blog site (which IS being indexed regularly).
So - this has me entirely stumped!!!! I just cannot see any reason why the site is not being indexed at all! The site has been live now for around 2 -3 months; and I've had other sites with far less content / active links etc etc being indexed in no time at all.
The website in question is www.waydownunder.com.au - if anyone had a minute to take a quick look and see if I've missed anything obvious, I would really really appreciate it.
Thanks kindly,
Matt.
-
Hi Matt,
I would echo Lynn's recommendations here.
I doubt Google is actively filtering the 2nd site from search results (the duplicate content filter is employed scarcely, you'll find no shortage of duplicated sites that are indexed - it's also more of a results filter than an index filter, meaning duplicate content is still indexed, it just isn't shown in SERPs when the filter is active).
It's more likely that you simply haven't sent Google a strong enough ping that the site is worth indexing. Generate some marketing activity around the site, link to it from the current site as Lynn suggested (esp. with turning those pages into summaries), and I expect the site will show up in the index within a couple of weeks.
Best of Luck,
Mike -
Hi Matt,
It can take some time to index new sites. Submitting a sitemap to GWT, building a couple of links and sharing it a bit on social channels will usually help speed up the process. I am not very familiar with google sites, but if you can re-enable the google hosted site then maybe it is an idea to announce there that the site is now hosted elsewhere and link to it. You could reduce the content on the google site pages to just an abstract/intro on each page and link to the full content which is now on the new site which should take care of duplicate content issues and also show a clear connection between the two of them (for both incoming users and search engines).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to manage user profiles in your website?
We have a real estate website in which agents and builders can create their profiles. My question is shall we use h1 or h2 tags in business profile pages or make them according to web 2.0 standards? In case header tags are used, if two agents have the same name and we have used h2 tag for them, then search result page will end up having two same h2's. Can someone please tell me the right way to manage business profiles in a website? Thanks
Intermediate & Advanced SEO | | dailynaukri1 -
Old pages STILL indexed...
Our new website has been live for around 3 months and the URL structure has completely changed. We weren't able to dynamically create 301 redirects for over 5,000 of our products because of how different the URL's were so we've been redirecting them as and when. 3 months on and we're still getting hundreds of 404 errors daily in our Webmaster Tools account. I've checked the server logs and it looks like Bing Bot still seems to want to crawl our old /product/ URL's. Also, if I perform a "site:example.co.uk/product" on Google or Bing - lots of results are still returned, indicating the both still haven't dropped them from their index. Should I ignore the 404 errors and continue to wait for them to drop off or should I just block /product/ in my robots.txt? After 3 months I'd have thought they'd have naturally dropped off by now! I'm half-debating this: User-agent: *
Intermediate & Advanced SEO | | LiamMcArthur
Disallow: /some-directory-for-all/* User-agent: Bingbot
User-agent: MSNBot
Disallow: /product/ Sitemap: http://www.example.co.uk/sitemap.xml0 -
Why is our website not generating organic traffic?
Our website is struggling to generate organic traffic over the past few months and we're lost as to why. It's a relatively new site. It's mobile friendly, all products have meta descriptions and product images have alt tags. Content is added regularly. Site speed could be better and alt tags need to be added to images on the blog but other than that we're stumped. Does anyone have any suggestions?
Intermediate & Advanced SEO | | Johnny_AppleSeed0 -
Home page not being indexed
Hi Moz crew. I have two sites (one is a client's and one is mine). They are both Wordpress sites and both are hosted on WP Engine. They have both been set up for a long time, and are "on-page" optimized. Pages from each site are indexed, but Google is not indexing the homepage for either site. Just to be clear - I can set up and work on a Wordpress site, but am not a programmer. Both seem to be fine according to my Moz dashboard. I have Webmaster tools set up for each - and as far as I can tell (definitely not an exper in webmaster tools) they are okay. I have done the obvious and checked that the the box preventing Google from crawling is not checked, and I believe I have set up the proper re-directs and canonicals.Thanks in advance! Brent
Intermediate & Advanced SEO | | EchelonSEO0 -
Drop in indexed pages!
Hi everybody! I've been working on http://thewilddeckcompany.co.uk/ for a little while now. Until recently, everything was great - good rankings for the key terms of 'bird hides' and 'pond dipping platforms'. However, rankings have tanked over the past few days. I can't point my finger at it yet, but a site:thewilddeckcompany.co.uk search shows only three pages have been indexed. There's only 10 on the site, and it was fine beforehand. Any advice would be much appreciated,
Intermediate & Advanced SEO | | Blink-SEO0 -
Getting Pages Requiring Login Indexed
Somehow certain newspapers' webpages show up in the index but require login. My client has a whole section of the site that requires a login (registration is free), and we'd love to get that content indexed. The developer offered to remove the login requirement for specific user agents (eg Googlebot, et al.). I am afraid this might get us penalized. Any insight?
Intermediate & Advanced SEO | | TheEspresseo0 -
Page indexed but not showing up at all in search results
I am currently working on the SEO for a roofing company. I have developed GEO targeted pages for both commercial and residential roofing (as well as attic insulation and gutters) and have hundreds of 1st page placements for the GEO targeted keywords. What is baffling me is that they are performing EXTREMELY poorly on the bigger cities, to the point of not evening showing up in the first 5 pages. I also target a page specifically for roof repair in Phoenix and it is not coming up AT ALL. This is not typically the results I get when directly targeting keywords. I'm working on implementing keyword variations as well as adding about 10 or so information pages (@ 700 words) regarding different roofing systems which I plan to cross link on the site, etc. I'm just wondering if there is a simple answer as to why the pages I want to be showing up the most are performing so poorly and what I would need to do to improve their rankings.
Intermediate & Advanced SEO | | dogstarweb0 -
Reducing Booking Engine Indexation
Hi Mozzers, I am working on a site with a very useful room booking engine. Helpful as it may be, all the variations (2 bedrooms, 3 bedrooms, room with a view, etc, etc,) are indexed by Google. Section 13 on Search Pagination in Dr. Pete's great post on Panda http://www.seomoz.org/blog/duplicate-content-in-a-post-panda-world speaks to our issue, but I was wondering since 2 (!) years have gone by, if there are any additional solutions y'all might recommend. We want to cut down on the duplicate titles and content and get the useful but not useful for SERPs online booking pages out of the index. Any thoughts? Thanks for your help.
Intermediate & Advanced SEO | | Leverage_Marketing0