Should I block google indexing "search.php"
-
My question is I have a search page on our website , you can search by date, number of people staying and so on, I am just wondering should block this in the robots.txt ? Because we have pretty URL'S already for searching by county and searching by towns. I cannot see any benefit of having e.g
"search/search.php?sp_dateFrom=16%2F12%2F2015&sp_dateTo=23%2F12%2F2015&sec_drop%5B%5D=727&spesh_town_id=764&q=&occupants=5&bedrooms=3&submit=SEARCH#search" indexed. Would I be correct in doing this ?
-
Second confirmation ;-), he's right. It's one of the things that for bigger sites really could get you in trouble.
-
That is the answer I was looking for, I was thinking along those lines. The problem was that Seo software was coming up with duplicate content because of different variations of the search parameters. Thanks very much for a clear and precise answer and taking time to explain this.
-
You want to block Google from any URL that produces a search result that is essentially a resorting or refiltering of a master list of search results that they have already crawled/indexed.
If you already have a set of pages that lets Google crawl all the pages in your site (could be all the products in your store, all the articles in your blog, etc), having Google crawl through variants of that same page causes a couple of problems. 1) You are wasting Google's time in spidering pages that it has already seen, vs having Google crawl your more important pages. Depending on how you have these setup, you may end up sending Google into an endless loop of non-important pages to crawl 2) You are creating pages that are generally low quality, have nothing truly original on them, they will not rank for anything anyway and may give the impression that your site consists of primarily low quality pages.
What I show Google is a single simple path to browse my content. For a blog this would be a chronological listing of articles that is paginated so that Google and the user can browse from my most recent to my oldest articles. For an ecommerce page, I might setup basic category pages, make sure the category pages have great content on them and then allow Google to crawl back through all the products based on those main category pages. If I have some products in 2 or 3 categories I do not sweat it. If on either of these examples, I show the user options to resort, filter, etc the results, I block Google with a nofollow or with robots.txt.
In your example, you already have "pretty" URLs by country and town, keep those, that will let Google and your users find your content and also provide context around that content. The crazy a$$ search URL you show is handy for your PHP code to give a search result, but would just waste Google's time. Unless you think it would be useful for a user to save the search URL results, I would see if there is a way to simply hide all the parameters from the user (submit the parameters using a POST vs a GET request for example) so that all they see in the URL result is /search/search.php
Good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Getting different search queries in Google Webmaster
Hi All, I have a website Afrofood.com. In it's Google webmaster search queries i have more than 90 Queries, but not a single query is related with this site. All queries are from different site or subject, they have no any relation with my site. Can any one please tell me how to correct this... Site is Afrofood.com related with African foods, recipes, spices and all that. But showing search queries are: [canada goose](https://www.google.com/webmasters/tools/top-search-queries?hl=en&siteUrl=http://afrofood.com/&authuser=1#canada goose) [canada goose outlet deutschland](https://www.google.com/webmasters/tools/top-search-queries?hl=en&siteUrl=http://afrofood.com/&authuser=1#canada goose outlet deutschland) [polizei shop düsseldorf](https://www.google.com/webmasters/tools/top-search-queries?hl=en&siteUrl=http://afrofood.com/&authuser=1#polizei shop düsseldorf) [canada goose deutschland](https://www.google.com/webmasters/tools/top-search-queries?hl=en&siteUrl=http://afrofood.com/&authuser=1#canada goose deutschland) [canada goose weste](https://www.google.com/webmasters/tools/top-search-queries?hl=en&siteUrl=http://afrofood.com/&authuser=1#canada goose weste) [canada goose kaufen](https://www.google.com/webmasters/tools/top-search-queries?hl=en&siteUrl=http://afrofood.com/&authuser=1#canada goose kaufen) [canada goose hamburg](https://www.google.com/webmasters/tools/top-search-queries?hl=en&siteUrl=http://afrofood.com/&authuser=1#canada goose hamburg) [canada goose größentabelle](https://www.google.com/webmasters/tools/top-search-queries?hl=en&siteUrl=http://afrofood.com/&authuser=1#canada goose größentabelle)
On-Page Optimization | | 1akal0 -
Multiple Addresses - Google places for business
Hi I need a little help, A client of ours has 4 business addresses and want to know, should we have all 4 in the footer of their website or should we just keep the relevant address to the relevant area page? Thanks
On-Page Optimization | | Mays-Digital0 -
Google Is Ranking the Wrong Page
Howdy Folks- I have a case where Google is ranking the wrong page for a couple of different keywords. The home page is: http://healthtn.com Most notably, we're trying to optimize the home page for "Tennessee Health Insurance" but the below page is what continually ranks for it, and does so very poorly. We used to be page two with the home page, now we are page four and it ranks the following page. http://healthtn.com/tennessee/health-insurance/student I have started directing our Internal Linking to reflect the correct anchor text but succeeded in losing ranking for the term, but am still ranking the wrong page. Any thoughts or help would be much appreciated!
On-Page Optimization | | CRO_first0 -
How can i block the below URLs
Google indexed plugins pages for my website. Please check below. How can stop them to be indexed on google.? http://www.ayurjeewan.com/wp-content/plugins/LayerSlider/static/skins/glass/ http://www.ayurjeewan.com/wp-content/plugins/LayerSlider/static/skins/borderlesslight3d/ http://www.ayurjeewan.com/wp-content/plugins/LayerSlider/static/skins/defaultskin/ My robots.txt file is - User-agent: * Disallow: /wp-admin/
On-Page Optimization | | MasonBaker0 -
Google Crawl Errors from vbseo change
We have vbseo setup on our site and for some reason a setting was changed unexpectedly and was un-noticed where it changed the URL of all the pages and so none of our pages were getting indexed by google any longer due to 401 errors. Most of our SE traffic fell off. We discovered the issue a couple weeks ago and we changed the setting back so that the URLs are the same as they were originally before but in Google webmasters it's still showing crawl errors and our search engine traffic hasn't recovered at all. We have sitemaps being sent daily.
On-Page Optimization | | RudySF0 -
Google Drop
I started using SEOMOZ due to a sudden and huge drop in Google for two main keywords (hair bows and baby headbands). Our site (BloomingBows.com) has held a top three spot for years with these words and then in the last few months has dropped down on the first page and now they are completely off the charts. Is there any insight as to why? Also, we have been very active using the data from here in the last week or so to clean up and improve anything listed, but I am still seeing keywords drop into the 40 - 60 position and our traffic is drying up. Starting to panic and wondering if I am missing something or going about this in the wrong way. ANY insight is appreciated at this point!! Thank you!!
On-Page Optimization | | bloomingB0 -
Will Google handle "this not that" pages differently?
If you create pages about "try keyword1 not keyword2" will there be any barriers to getting the pages ranked for keyword2? Example: You have furnished rental units in a small town, and you offer nightly/weekly rentals. You want to rank for "town hotel" since you offer the same service as a hotel. Since you're not really a hotel, you create a page called "Better than a hotel: Town nightly rental units". Anyone know if Google has an algorithm to detect this (they would have to detect the meaning of the words you were using and know that you were promoting something other than a hotel) and determine you're not really relevant to "town hotel" and not rank you well? I think they probably do not, as I've seen things like Google Adsense Alternatives articles ranking well for the term Google Adsense, or Boycott Godaddy sites ranking well for the term godaddy. But I would like to hear any evidence or facts others know of.
On-Page Optimization | | AdamThompson0 -
Getting pages indexed by Google
Hi SEOMoz, I relaunched a site back in February of this year (www.uniquip.com) with about 1 million URL's. Right now I'm seeing that Google is not going past 110k indexed URL's (based on sitemaps). Do you have any tips on what I can do to make the site more likeable by Google and get more indexed URL's? All the the part pages can be browsed to by going to: http://www.uniquip.com/product-line-card/suppliers/sw-a/p-1 I've tried to make the content as unique as possible by adding random testimonials and random "related part numbers" see here: http://www.uniquip.com/id/246172/electronic-components/infineon/microcontrollers-mcu/sabc161pilfca Do I need to wait more time and be more patient with Google? It just seems like I'm only getting a few thousand URL's per day at the most. Would it help me if I implemented a breadcrumb on all part pages? Thanks, -Carlos
On-Page Optimization | | caneja0