Https indexed - though a no index no follow tag has been added
-
Hi,
The https-pages of our booking section are being indexed by Google. We added
But the pages are still being indexed. What can I do to exclude these URL's from the Google index?
Thank you very much in advance!
Kind regards,
Dennis Overbeek
ACSI Publishing | dennis@acsi.eu
-
Assuming the website we're talking about is the same as in your email address, I find the meta robots tag
For the page https:// webshop . acsi . eu / en / checkout / onepage / (spaced to prevent indexation of this post).
Are you sure the right meta tags are in place?
-
The only solution I can think of is to use an htaccess file to determine if you're using SSL or not and then feed up a special robots.txt to disallow crawling for the SSL site.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
No index tag robots.txt
Hi Mozzers, A client's website has a lot of internal directories defined as /node/*. I already added the rule 'Disallow: /node/*' to the robots.txt file to prevents bots from crawling these pages. However, the pages are already indexed and appear in the search results. In an article of Deepcrawl, they say you can simply add the rule 'Noindex: /node/*' to the robots.txt file, but other sources claim the only way is to add a noindex directive in the meta robots tag of every page. Can someone tell me which is the best way to prevent these pages from getting indexed? Small note: there are more than 100 pages. Thanks!
Technical SEO | | WeAreDigital_BE
Jens0 -
Should I use canonical tag in these cases?
Should I use canonical tag in these cases? On the page itself (with the tag pointing to itself) On pages that doesn't have duplicate versions
Technical SEO | | GoMentor0 -
Unique use of nofollow tag
Love the community here. I just had a quick question about the using noindex, nofollow. We are a car dealership group that uses a website provider (cobalt). Since they provide the website they are the only ones with access to remove pages etc. We can add pages but only they can remove them. There are some pages we need to have removed but according to them they are unable to remove them, (I think the manufacture might mandate having some pages), anyway some of these pages literally have nothing on them, and there isn't really any useful content we could add to them. So we are using noindex on them to ensure that they stay out of search indices, but I am wondering if we should also use nofollow on them. If I understand nofollow correctly it just means search engines won't follow the links on the page, well for most of these pages the only links on them are the navigation, and since we don't plan on adding any content to these pages and we can't remove them should we use noindex and nofollow as a way to "remove" them from the site as much as we can?
Technical SEO | | Murdock_Auto_Group0 -
Changing a site from http to https
Will my rankings be affected if I change domain from http to https and force redirect?
Technical SEO | | Clickatell20 -
Homepage no longer indexed in Google
Have been working on a site and the hompage has recently vanished from Google. I submit the site to Google webmaster tools a couple of days ago and checked today and the homepage has vanished. There are no no follow tags, and no robots.txt stopping the page from being crawled. It's a bit of a worry, the site is http://www.beyondthedeal.com
Technical SEO | | tonysandwich
Any insights would be massively appreciated! Thanks.0 -
Google Off/On Tags
I came across this article about telling google not to crawl a portion of a webpage, but I never hear anyone in the SEO community talk about them. http://perishablepress.com/press/2009/08/23/tell-google-to-not-index-certain-parts-of-your-page/ Does anyone use these and find them to be effective? If not, how do you suggest noindexing/canonicalizing a portion of a page to avoid duplicate content that shows up on multiple pages?
Technical SEO | | Hakkasan1 -
Understanding No Follow
We manage a couple of sites with 100s of pages... Most of the sites have content that is not helpful as landing pages but obviously has relevent content related to our desired search terms. Some of links go off site to another domain. I am trying to understand the issue of "link juice" and if I gain it or lose it by putting "nofollow" designation on some of the page links. Specifically, do I increase the value of my pages if I put no follow tags on lower tier links off of these pages. Here is a page in question - http://www.vahmarketing.com/product/ductless-hoods Is there a best practice or SEO rule for using "no follow"? Thanks, Bob Nance
Technical SEO | | impressem0 -
Is this 404 page indexed?
I have a URL that when searched for shows up in the Google index as the first result but does not have any title or description attached to it. When you click on the link it goes to a 404 page. Is it simply that Google is removing it from the index and is in some sort of transitional phase or could there be another reason.
Technical SEO | | bfinternet0