Hi,

Thanks, I will do some testing to confirm that this behaves how I would like it to

When you say:

nofollow will tell the crawlers to not crawl the page

I believe you mean to say that this will tell the crawlers not to crawl the links on the page, the page itself is itself still "crawled" is it not?

But yes, you are right to say, that once robots.txt disallow is in place, the meta tag will not be seen and thus be moot (at which point I may as well take it off).

It would be nice to be able to say "don't crawl this and don't put it in the index"... but is there a way?

Hi, we have an alternate "list view" version of every one of our search results pages

The list view has its own URL, indicated by a URL parameter

I'm concerned about wasting our crawl budget on all these list view pages, which effectively doubles the amount of pages that need crawling

When they were first launched, I had the noindex meta tag be placed on all list view pages, but I'm concerned that they are still being crawled

Should I therefore go ahead and also apply a robots.txt disallow on that parameter to ensure that no crawling occurs? Or, will Googlebot/Bingbot also stop crawling that page over time? I assume that noindex still means "crawl"...

Thanks