Internal search pages (and faceted navigation) solutions for 2018! Canonical or meta robots "noindex,follow"?
-
There seems to conflicting information on how best to handle internal search results pages.
To recap - they are problematic because these pages generally result in lots of query parameters being appended to the URL string for every kind of search - whilst the title, meta-description and general framework of the page remain the same - which is flagged in Moz Pro Site Crawl - as duplicate, meta descriptions/h1s etc.
The general advice these days is NOT to disallow these pages in robots.txt anymore - because there is still value in their being crawled for all the links that appear on the page. But in order to handle the duplicate issues - the advice varies into two camps on what to do:
1. Add meta robots tag - with "noindex,follow" to the page
This means the page will not be indexed with all it's myriad queries and parameters. And so takes care of any duplicate meta /markup issues - but any other links from the page can still be crawled and indexed = better crawling, indexing of the site, however you lose any value the page itself might bring.
This is the advice Yoast recommends in 2017 : https://yoast.com/blocking-your-sites-search-results/ - who are adamant that Google just doesn't like or want to serve this kind of page anyway...2. Just add a canonical link tag - this will ensure that the search results page is still indexed as well.
All the different query string URLs, and the array of results they serve - are 'canonicalised' as the same.
However - this seems a bit duplicitous as the results in the page body could all be very different. Also - all the paginated results pages - would be 'canonicalised' to the main search page - which we know Google states is not correct implementation of canonical tag
https://webmasters.googleblog.com/2013/04/5-common-mistakes-with-relcanonical.htmlthis picks up on this older discussion here from 2012
https://moz.com/community/q/internal-search-rel-canonical-vs-noindex-vs-robots-txt
Where the advice was leaning towards using canonicals because the user was seeing a percentage of inbound into these search result pages - but i wonder if it will still be the case ?As the older discussion is now 6 years old - just wondering if there is any new approach or how others have chosen to handle internal search
I think a lot of the same issues occur with faceted navigation as discussed here in 2017
https://moz.com/blog/large-site-seo-basics-faceted-navigation
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate pages and Canonicals
Hi all, Our website has more than 30 pages which are duplicates. So canonicals have been deployed to show up only 10 of these pages. Do more of these pages impact rankings? Thanks
Intermediate & Advanced SEO | | vtmoz0 -
Indexation of internal search results from infinite scroll
Hello, I have an issue where we will have a website set up with dynamic (AJAX) result pages based on the selection of certain filters chosen by the user. The result page will have 12 results shown and if the user scrolls down, the page will lazy load (infinite scroll) additional results. So for example, with these filters: Filter A: Size Filter B: Color Filter 😄 Location We could potentially have a page for "Large, Blue, New York" results dynamically generated. My issue is that I want Google to potentially crawl and index all these variations, so that I can have a page that ranks for "Large Blue New York", another page that ranks for "Small Orange Miami" etc. However, I do not need all the products indexed--- just the page with the first set of dynamic results would be enough since the additional products would just be more of the same. In other words, I am trying to get these pages with filters applied indexed and not necessarily get every possible product indexed. Can anyone comment on the best way to Get Google to index all dynamic variations? The proper way of paginating pages? Thank you
Intermediate & Advanced SEO | | Digi12340 -
Redirect old "not found" url (at http) to new corresponding page (now at https)
My least favorite part of SEO 😉 I'm trying to redirect an old url that no longer exists to our new website that is built with https. The old url: http://www.thinworks.com/palm-beach-gardens-team/ New url: https://www.thinworks.com/palm-beach-gardens/ This isn't working with my standard process of the quick redirection plugin in WP or through htaccess because the old site url is at http and not https. Any help would be much appreciated! How do I accomplish this, where do I do it and what's the code I'd use? Thank you Moz community! Ricky
Intermediate & Advanced SEO | | SUCCESSagency0 -
What is better? No canonical or two canonicals to different pages?
I have a blogger site that is adding parameters and causing duplicate content. For example: www.mysite.com/?spref=bl
Intermediate & Advanced SEO | | TMI.com
www.mysite.com/?commentPage=1 www.mysite.com/?m=1 www.mysite.com/?m=0 I decided to implement a canonical tag on these pages pointing to the correct version of the page. However, for the parameter ?m=0, the canonical keeps pointing to itself. Ex: www.mysite.com/?m=0 The canonical = www.mysite.com/?m=0 So now I have two canonicals for the same page. My question is if I should leave it, and let Google decide, or completely remove the canonicals from all pages?0 -
Meta canonical or simply robots.txt other domain names with same content?
Hi, I'm working with a new client who has a main product website. This client has representatives who also sells the same products but all those reps have a copy of the same website on another domain name. The best thing would probably be to shut down the other (same) websites and redirect 301 them to the main, but that's impossible in the minding of the client. First choice : Implement a conical meta for all the URL on all the other domain names. Second choice : Robots.txt with disallow for all the other websites. Third choice : I'm really open to other suggestions 😉 Thank you very much! 🙂
Intermediate & Advanced SEO | | Louis-Philippe_Dea0 -
Do Follow and No Follow Attributes?
I have a blog on Trulia and Active Rain which are real estate websites. I see that they both are Do Follow. My question is how much link juice do these sites pass a long to my site when I write a blog post on these sites and create a link to my main site? I've heard somewhere that even though a link has a Do Follow attribute it passes little link juice in certain cases like a no follow attribute. Also, if a link is a No Follow link, does it still pass along some link juice or is it completely juiceless. Is there a way to see which sites pass the most link juice to my site? Thanks all.
Intermediate & Advanced SEO | | bronxpad1 -
Can you use more than one meta robots tag per page?
If you want to add both "noindex, follow" and "noopd" should you add two meta robots tags or is there a way to combine both into one?
Intermediate & Advanced SEO | | nicole.healthline0 -
Should I nofollow the main navigation on certain pages?
We have several large Ecommerce sites with hundreds of links on each page. I have been trying to think of ways to focus our internal linking to increase certain pages relevancy. My thought was to put nofollow in the main navigation (since there are hundreds of links there controlled by dropdowns) and only follow the links on each page for the products we are selling and promoting (15-20 links). I would still be using a sitemap that includes the links. Is this a terrible idea? if a link is nofollowed in the main navigation does that still count as the one mention for google if it points to the same page that a normal link points too that is in the content of the page? since all of the main navigation is the same on every page of the website would it be good to only put nofollow on the subpages/subsections and leave the home page navigation alone (that would allow the spiders to crawl all of those links on the home page but not crawl those same links on the subsections where I could then focus the linking).
Intermediate & Advanced SEO | | bigtimeseo0