Google de-indexed a page on my site
-
I have a site which is around 9 months old. For most search terms we rank fine (including top 3 rankings for competitive terms).
Recently one of our pages has been fluctuating wildly in the rankings and has now disappeared altogether from the rankings for over 1 week.
As a test I added a similar page to one of my other sites and it ranks fine.
I've checked webmaster tools and there is nothing of note there.
I'm not really sure what to do at this stage. Any advice would me much appreciated!
-
Another thing which is weird:
If I google "site:medexpress.co.uk" the page /clinics/erectile-dysfunction/viagra appears.
If I google "site:medexpress.co.uk viagra" that page no longer appears!
I could see why my page would have maybe dropped in the rankings but to go from a rank of around 30-70 for most of the keywords for this page to dropping off the index points to something more extraordinary. Its been like this for almost two weeks and I'm considering maybe changing the URL (as I mentioned other long-tail optimized blog pages are now starting to rank so it appears to be just this page).
Is it possible this page has been moved to the supplemental index for some reason?
-
Hi,
The domain actually has plenty of links and that page has two very high quality backlinks. The Moz tool for some reason is missing almost all the backlinks. If you use AHREFS it works much better (remembering to use www as the prefix for the domain).
The domain authority is 49 which is much higher than the bulk of sites on there and higher than the site in position number #1 which has somehow managed to rank with almost no backlinks (it has less than 20) or any quality content.
Whats even weirded I added a page to my other site www.centraltravelclinic.co.uk and it now outranks my main site even though it has less backlinks/relevant content.
There is even a page in my blog section which is now ranking as well.
I'm not sure but it seems as if there is some penalty against this one page...or something has gone wrong on the search index and it has been temporarily removed for whatever reason.
Regards,
Dwayne
-
Hi Everett,
I agree 100% the domain itself has a great name, the lack of domain authority or links undoubtably has taken its toll surprised it ranks for anything the honest without any authority.
A content marketing campaign with high quality content covering the topics he discussed like law, medical care and including tools for the end-user would make it extremely brand worthy.
I think the best way to go about it would be to start a six-month campaign and do some very aggressive work on site.
You have some great advice.
Sincerely,
Thomas
-
Thank you Thomas,
I did have a look at the site and came to the conclusion that it had relatively no domain authority or page/URL-level authority from quality backlinks. The page had no links, and the domain only had a couple, neither of them great. As you mention, this industry is very competitive. It is one of the most competitive niches online.
My recommendation was to embark on a content marketing campaign, possibly one that highlights medical care / law / coverage disparities between countries. The domain itself is very brandable, and if they were to latch onto a hot-topic issue in the right way they could get quoted as experts in that industry by major news outlets, or at least some decent blogs. Meanwhile, steady posting about the lindustry on the blog, occasional white papers or studies created by the company about the the industry... will help build their body of content and present their expertise on the topic. Any tool (calculators, price comparison charts, etc...) would also help. I also mentioned a recommended minimum budget for content creation and paid promotion of it over the next six months.
-
Hi Everett,
There is a good reason for him not not actually posting URL for keywords wants list for.
I think Deelo555 should private message you the information he sent me. They are keywords that are commonly thought of negatively is all I will say.
Deelo555 please send Everett what you sent me.
All the best,
Thomas
-
Deelo555 We'll need more information to be of much help here. Can you post the site and/or the keyword? If not, this is probably going to have to be assisted by private message with someone.
I'd look for over-optimized anchor text or spammy links going into that page just to make sure. From there I would look into whether the content on the page "should" rank for the keyword. In other words, does it answer the query or give the searcher what they are looking for? After that I would move on to general user experience. Does the site look good, trustworthy, authoritative...
Follow that path and you'll probably uncover some things to improve. If not, let us know.
-
I replied to the private message I hope it is helpful.
-
Fluxing sometimes can mean Google is testing your site verse the other competitors for that keyword.
If Google is unable to determine what is the most enjoyed by the end-user so they will allow for you to fluctuate in the SERPS.
If people query your keyword find your site in the SERPS then immediately leave once they have landed on your website. That is called "Pogo sticking" Google is simply trying to find out whether or not you are the best fit for that keyword.
1st off if you could test the site some of the tools below
https://moz.com/researchtools/crawl-test
http://deepcrawl.co.uk/ (Amazing tool)
http://www.screamingfrog.co.uk/seo-spider/ ( everyone should have a copy I recommend the paid but you can crawl 500 pages for free using SF free addition)
You want to be see what Google bot can see your site can do that using
http://www.feedthebot.com/tools/
Check your Robots.txt using
http://www.internetmarketingninjas.com/seo-tools/robots-txt-generator/ ( this will pull the file sometimes there are more than 1 it does happen)
make sure that if you're using WordPress or other similar CMS is that Google bot is not being blocked from seeing J query
The reason for this is Google cannot see the site as it might be shown to the end user therefore they would be less likely to come back & index
https://www.authoritydev.com/dont-block-jquery-from-googlebot/
once we have completed eliminated and chance of robots.txt or no follow / no index then you will want to look at your entire website Very thoroughly.
I do not know how old your domain is could you share its age?
what is your domain authority? what is the page authority of pages not being indexed?
we need to look at all of this before we can render a verdict.
If you're uncomfortable sharing your URL publicly you're welcome to send it to me privately.
what type of URLs are pointing (if any) Internal or external are pointing at your pages that are not indexing.
Sincerely,
Thomas
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Redirecting Pages During Site Migration
Hi everyone, We are changing a website's domain name. The site architecture will stay the same, but we are renaming some pages. How do we treat redirects? I read this on Search Engine Land: The ideal way to set up your redirects is with a regex expression in the .htaccess file of your old site. The regex expression should simply swap out your domain name, or swap out HTTP for HTTPS if you are doing an SSL migration. For any pages where this isn’t possible, you will need to set up an individual redirect. Make sure this doesn’t create any conflicts with your regex and that it doesn’t produce any redirect chains. Does the above mean we are able to set up a domain redirect on the regex for pages that we are not renaming and then have individual 1:1 redirects for renamed pages in the same .htaccess file? So have both? This will not conflict with the regex rule?
Intermediate & Advanced SEO | | nhhernandez0 -
Removing pages from index
My client is running 4 websites on ModX CMS and using the same database for all the sites. Roger has discovered that one of the sites has 2050 302 redirects pointing to the clients other sites. The Sitemap for the site in question includes 860 pages. Google Webmaster Tools has indexed 540 pages. Roger has discovered 5200 pages and a Site: query of Google reveals 7200 pages. Diving into the SERP results many of the pages indexed are pointing to the other 3 sites. I believe there is a configuration problem with the site because the other sites when crawled do not have a huge volume of redirects. My concern is how can we remove from Google's index the 2050 pages that are redirecting to the other sites via a 302 redirect?
Intermediate & Advanced SEO | | tinbum0 -
Why are some pages indexed but not cached by Google?
The question is simple but I don't understand the answer. I found a webpage that was linking to my personal site. The page was indexed in Google. However, there was no cache option and I received a 404 from Google when I tried using cache:www.thewebpage.com/link/. What exactly does this mean? Also, does it have any negative implication on the SEO value of the link that points to my personal website?
Intermediate & Advanced SEO | | mRELEVANCE0 -
How to know if your site has been penalized by Google
Hello, One of my clients ranking drop dramatically.
Intermediate & Advanced SEO | | ogdcorp
We believe it was due to an upgrade to his site. While the site was live www.clientdomain.com
Work was being done on the new site www.clientdomain.com/new (1 month) I think google crawled the /new link and took as a content duplication since both sites had the same content. Is there a MOZ tool to see if a site has been penalized or any online tool? Thanks0 -
How is Google crawling and indexing this directory listing?
We have three Directory Listing pages that are being indexed by Google: http://www.ccisolutions.com/StoreFront/jsp/ http://www.ccisolutions.com/StoreFront/jsp/html/ http://www.ccisolutions.com/StoreFront/jsp/pdf/ How and why is Googlebot crawling and indexing these pages? Nothing else links to them (although the /jsp.html/ and /jsp/pdf/ both link back to /jsp/). They aren't disallowed in our robots.txt file and I understand that this could be why. If we add them to our robots.txt file and disallow, will this prevent Googlebot from crawling and indexing those Directory Listing pages without prohibiting them from crawling and indexing the content that resides there which is used to populate pages on our site? Having these pages indexed in Google is causing a myriad of issues, not the least of which is duplicate content. For example, this file <tt>CCI-SALES-STAFF.HTML</tt> (which appears on this Directory Listing referenced above - http://www.ccisolutions.com/StoreFront/jsp/html/) clicks through to this Web page: http://www.ccisolutions.com/StoreFront/jsp/html/CCI-SALES-STAFF.HTML This page is indexed in Google and we don't want it to be. But so is the actual page where we intended the content contained in that file to display: http://www.ccisolutions.com/StoreFront/category/meet-our-sales-staff As you can see, this results in duplicate content problems. Is there a way to disallow Googlebot from crawling that Directory Listing page, and, provided that we have this URL in our sitemap: http://www.ccisolutions.com/StoreFront/category/meet-our-sales-staff, solve the duplicate content issue as a result? For example: Disallow: /StoreFront/jsp/ Disallow: /StoreFront/jsp/html/ Disallow: /StoreFront/jsp/pdf/ Can we do this without risking blocking Googlebot from content we do want crawled and indexed? Many thanks in advance for any and all help on this one!
Intermediate & Advanced SEO | | danatanseo0 -
Can we retrieve all 404 pages of my site?
Hi, Can we retrieve all 404 pages of my site? is there any syntax i can use in Google search to list just pages that give 404? Tool/Site that can scan all pages in Google Index and give me this report. Thanks
Intermediate & Advanced SEO | | mtthompsons0 -
Google is indexing wordpress attachment pages
Hey, I have a bit of a problem/issue what is freaking me out a bit. I hope you can help me. If i do site:www.somesitename.com search in Google i see that Google is indexing my attachment pages. I want to redirect attachment URL's to parent post and stop google from indexing them. I have used different redirect plugins in hope that i can fix it myself but plugins don't work. I get a error:"too many redirects occurred trying to open www.somesitename.com/?attachment_id=1982 ". Do i need to change something in my attachment.php fail? Any idea what is causing this problem? get_header(); ?> /* Run the loop to output the attachment. * If you want to overload this in a child theme then include a file * called loop-attachment.php and that will be used instead. */ get_template_part( 'loop', 'attachment' ); ?>
Intermediate & Advanced SEO | | TauriU0 -
Why are so many pages indexed?
We recently launched a new website and it doesn't consist of that many pages. When you do a "site:" search on Google, it shows 1,950 results. Obviously we don't want this to be happening. I have a feeling it's effecting our rankings. Is this just a straight up robots.txt problem? We addressed that a while ago and the number of results aren't going down. It's very possible that we still have it implemented incorrectly. What are we doing wrong and how do we start getting pages "un-indexed"?
Intermediate & Advanced SEO | | MichaelWeisbaum0