Google still listing old domain
-
Hi
We moved to a new domain back in March 2014 and redirected most pages with a 301 and submitted change of domain request through Google Webmaster tools. A couple of pages were left as 302 redirect as they had rubbish links pointing to them and we had previously had a penalty.
Google was still indexing the old domain and our rankings hadn't recovered. Last month we took away the 302 redirects and just did a blanket 301 approach from old domain to new in the the thinking that as the penalty had been lifted from the old domain there was no harm in sending everything to new domain.
Again, we submitted the change of domain in webmaster tools as the option was available to us but its been a couple of weeks now and the old domain is still indexed
Am I missing something? I realise that the rankings may not have recovered partly due to the disavowing / disregarding of several links but am concerned this may be contributing
-
Hi
I now have a robots.txt for the old site and I created a sitemap by replacing the current domain with the old one and uploaded.
Weirdly when I search for the non-www version of the old domain the pages indexed has increased!
According to WMT the Crawl postponed because robots.txt was inaccessible however I've checked it returns status 200 and the Robots.txt Tester says it's successful even though it never updates the timestamp.
-
Hi Marie
Many thanks for your response,
I've just looked in Webmater tools at the old domain and the option to change domains is there again but I also noticed when looking at the crawl errors there was a message along the lines of crawl postponed as robots.txt was inaccessible.
At the moment it's just a blanket redirect at IIS level so following your advice I'll re-establish the old site's robots.txt and a sitemap and see if Google crawls the 301's to the new domain.
In some ways I'm glad I haven't missed anything but would be nice if just the new domain indexed after all this time !
Thanks again
-
This is odd. The pages all seem to redirect from the old site to the new, so why is Google still indexing those old pages?
I can't see the robots.txt on the old site as it redirects, but is it possible that the robots.txt on fhr-net.co.uk is blocking Google? If this is the case, then Google probably wouldn't be able to see the old site and recognize the redirects.
It may also help to add a sitemap for the old site and also to ask Google to fetch and render the old site's pages and then submit them to the index. This should cause the 301's to be seen and processed by Google.
-
Even after all this time, there are still over 700 pages indexed on our old domain even though we have submitted the change of address twice in Webmaster tools, the second one being about 6 months ago if not longer
old domain is www.fhr-net.co.uk
Any advice would be appreciated
-
No worries,
I appreciate you taking the time to answer my question
-
I think that I'm so used to answering questions about penalized sites that I assumed that you had moved domains because of a penalty. My apologies!
Sounds like you've got the right idea.
-
Thanks for responses,
One week on and since submitting the second change of domain in GWT we've seen the number of pages indexed for the old domain drop from over 1300 to around 700 this week which is something
Regarding the redirect debate, it's an interesting read thanks for sending that. Isn't the situation the same as a site that didn't have a penalty in that you should be monitoring your backlink profile and reconfiguring or disavowing links outside the guidelines whilst carrying out activities that will naturally build decent links and therefore redress the balance?
-
This doesn't answer your question, but I just wanted to point out that the 301 or 302 redirects are not a good idea. Even if you got the penalty lifted, there still can be unnatural links there that can harm you in the eyes of the Penguin algorithm. A 301 will redirect those bad links to the new site. A 302, if left in place long enough will do the same.
Here's an article I wrote today that goes into greater detail:
-
Oh, it may be that it's the other way around with canonical URL-s. At least according to Google (here: https://support.google.com/webmasters/answer/6033086?hl=en
- _Each destination URL should have a self-referencing rel="canonical" meta tag. _
-
Hmm.. certainly someone with more experience than myself would have a more elegant solution, but I would still try to do this by establishing the canonical URL because you don't want to delist: https://support.google.com/webmasters/answer/139066#6
If you can configure your server, you can use
rel="canonical"
HTTP headers to indicate the canonical URL for HTML documents and other files such as PDFs. Say your site makes the same PDF available via different URLs (for example, for tracking purposes), like this:_http://www.example.com/downloads/white-paper.pdf http://www.example.com/downloads/partner-1/white-paper.pdf http://www.example.com/downloads/partner-2/white-paper.pdf http://www.example.com/downloads/partner-3/white-paper.pdf_
In this case, you can use a
rel="canonical"
HTTP header to specify to Google the canonical URL for the PDF file, as follows:Link: <http: www.example.com="" downloads="" white-paper.pdf="">; rel="canonical"</http:>
-
Hi there
The old pages don't exist any more to add the canonical they're 301's from old domain to new but over 1000 pages show up for site:www.fhr-net.co.uk
-
Got it, you must have tried adding the canonical URL meta tags already, right? If not, check out: http://moz.com/blog/rel-confused-answers-to-your-rel-canonical-questions
"...in late 2009, Google announced support for cross-domain use of rel=canonical. This is typically for syndicated content, when you’re concerned about duplication and only want one version of the content to be eligible for ranking...
..First off, Google may choose to ignore cross-domain use of rel=canonical if the pages seem too different or it appears manipulative. The ideal use of cross-domain rel=canonical would be a situation where multiple sites owned by the same entity share content, and that content is useful to the users of each individual site. In that case, you probably wouldn’t want to use 301-redirects (it could confuse users and harm the individual brands), but you may want to avoid duplicate content issues and control which property Google displays in search results. I would not typically use rel=canonical cross-domain just to consolidate PageRank..."
-
Thanks for your reply,
It's not that I want to de-list the old domain as I would rather people get to the site using that domain than not at all but, my concern is that for whatever reason the transfer hasn't completed as it's been such a long time and we're for instance not getting the full benefit of sites linking to the old domain passed to the new one
-
If your goal is to delist the old domain I am going to copy the answer I just gave at http://moz.com/community/q/how-to-exclude-all-pages-on-a-subdomain-for-search, simply because it's clear and works quickly (48h) in my experience.
This is the authoritative way that Google recommends at https://support.google.com/webmasters/answer/1663419?hl=en&rd=1:
- Add an robots.txt file for your domain. Usually via FTP. Add the "noindex" meta-tags to every page as well.
- Add your subdomain as a separate site in Google Webmaster Tools
- On the Webmaster Tools home page, click the site you want.
- On the Dashboard, click Google Index on the left-hand menu.
- Click Remove URLs.
- Click New removal request.
- Type the URL of the page you want removed from search results (not the Google search results URL or cached page URL), and then click Continue. How to find the right URL. The URL is case-sensitive—use exactly the same characters and capitalization that the site uses.
- Click Yes, remove this page.
- Click Submit Request.
To exclude the entire domain, simply enter the domain URL (e.g. http://domain.com) at the 7th step.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Domain Authority Dropped and Indexed Pages Went Down on Google?
Hi there, We run an e-commerce site on Shopify. Our Domain Authority was 28 at the start of our campaign in May of this year. We also had 610 indexed pages on Google. We did some SEO work which included: Renaming Images for SEO Adding in alt tags Optimizing the meta title to "Product Name - Keyword - Brand Name" for products Optimizing meta descriptions Transition of Hubspot blog to Shopify (it was on a subdomain at Hubspot previously) Fixing some 404s Resubmitting site map after the changes Now it is almost at the 3-month mark and it looks like our Domain Authority has gone down 4 points to 24. The # of indexed pages has gone to down to 555. We made sure all our SEO updates weren't spammy or keyword-stuffed, but took a natural and helpful-sounding approach. We followed guidelines. So there shouldn't be any penalty right? I checked site traffic and it does not coincide with the drop. Our site traffic remains steady. I also looked at "site:" as well as conducted some test searches for the important pages (i.e. main pages, blog pages, and product pages) and they still come up on Google. So could it only be non-important pages being deindexed? My questions are: Why did both the Domain Authority and # of indexed pages go down? Is there any way to see which pages were deindexed? I checked Google Search Console, but couldn't find it. Thank you!
Intermediate & Advanced SEO | | kindalpaca70 -
Is there any significant benefit to creating online directory listings that only provide nofollow links to our domain?
Is there any significant benefit to creating online directory listings that only provide nofollow links to our domain? For context, whilst doing link gap analysis I've found our competitors are listed on local government directories such as getsurrey.co.uk and miltonkeynes.co.uk. Whilst these aren't seen as spam directories, it's still highly unlikely we'll receive much traffic through them. The links they provide to our domain have the nofollow tag. So I wonder whether there's any other benefit to investing the time in creating these listings? Would be interested to hear your thoughts Many thanks in advance
Intermediate & Advanced SEO | | Opera-Care1 -
How can I make a list of all URLs indexed by Google?
I started working for this eCommerce site 2 months ago, and my SEO site audit revealed a massive spider trap. The site should have been 3500-ish pages, but Google has over 30K pages in its index. I'm trying to find a effective way of making a list of all URLs indexed by Google. Anyone? (I basically want to build a sitemap with all the indexed spider trap URLs, then set up 301 on those, then ping Google with the "defective" sitemap so they can see what the site really looks like and remove those URLs, shrinking the site back to around 3500 pages)
Intermediate & Advanced SEO | | Bryggselv.no0 -
Video SEO for Google
I was wondering what the prime factors were to make something rank for a video on Google. Does anyone have any suggestions? I think that length may be important, but I don't know what the ideal run time is. Hypothetically for local SEO, would I be better off doing a tag like "Mercedes Buffalo NY" or do individual tags of "Mercedes" and "Buffalo" Thanks!
Intermediate & Advanced SEO | | oomdomarketing0 -
Is there a way to get a list of Total Indexed pages from Google Webmaster Tools?
I'm doing a detailed analysis of how Google sees and indexes our website and we have found that there are 240,256 pages in the index which is way too many. It's an e-commerce site that needs some tidying up. I'm working with an SEO specialist to set up URL parameters and put information in to the robots.txt file so the excess pages aren't indexed (we shouldn't have any more than around 3,00 - 4,000 pages) but we're struggling to find a way to get a list of these 240,256 pages as it would be helpful information in deciding what to put in the robots.txt file and which URL's we should ask Google to remove. Is there a way to get a list of the URL's indexed? We can't find it in the Google Webmaster Tools.
Intermediate & Advanced SEO | | sparrowdog0 -
New Domain Vs. Existing Domain
Hello, A potential client of mine has been blacklisted because of bad SEO process basically they have over 1,500 toxic links on their site. They have penalised to such an extent that they are now on page 12 for most of their keywords and not ranking well on brand terms either. They are keen to on to a new domain entirely and ditch their current domain when we design their new site. I wanted to get people's opinion on whether this is the best course of action or should we try to salvage the current domain? Many thanks, Mat
Intermediate & Advanced SEO | | Barques-Design0 -
Redirecting a Page from Domain A to Domain B
We have a page on Domain A, an established and well-ranking website, that would be more appropriate on Domain B, a site that we launched about two years ago. This page ranks well, pulls nice search traffic and has traffic from external links. We would like to move the page and its traffic from Domain A to Domain B using a 301 redirect. Have you ever done this or have you heard of how it has worked for someone else? Thanks!
Intermediate & Advanced SEO | | EGOL0 -
Disallowed Pages Still Showing Up in Google Index. What do we do?
We recently disallowed a wide variety of pages for www.udemy.com which we do not want google indexing (e.g., /tags or /lectures). Basically we don't want to spread our link juice around to all these pages that are never going to rank. We want to keep it focused on our core pages which are for our courses. We've added them as disallows in robots.txt, but after 2-3 weeks google is still showing them in it's index. When we lookup "site: udemy.com", for example, Google currently shows ~650,000 pages indexed... when really it should only be showing ~5,000 pages indexed. As another example, if you search for "site:udemy.com/tag", google shows 129,000 results. We've definitely added "/tag" into our robots.txt properly, so this should not be happening... Google showed be showing 0 results. Any ideas re: how we get Google to pay attention and re-index our site properly?
Intermediate & Advanced SEO | | udemy0