Should I block google indexing "search.php"
-
My question is I have a search page on our website , you can search by date, number of people staying and so on, I am just wondering should block this in the robots.txt ? Because we have pretty URL'S already for searching by county and searching by towns. I cannot see any benefit of having e.g
"search/search.php?sp_dateFrom=16%2F12%2F2015&sp_dateTo=23%2F12%2F2015&sec_drop%5B%5D=727&spesh_town_id=764&q=&occupants=5&bedrooms=3&submit=SEARCH#search" indexed. Would I be correct in doing this ?
-
Second confirmation ;-), he's right. It's one of the things that for bigger sites really could get you in trouble.
-
That is the answer I was looking for, I was thinking along those lines. The problem was that Seo software was coming up with duplicate content because of different variations of the search parameters. Thanks very much for a clear and precise answer and taking time to explain this.
-
You want to block Google from any URL that produces a search result that is essentially a resorting or refiltering of a master list of search results that they have already crawled/indexed.
If you already have a set of pages that lets Google crawl all the pages in your site (could be all the products in your store, all the articles in your blog, etc), having Google crawl through variants of that same page causes a couple of problems. 1) You are wasting Google's time in spidering pages that it has already seen, vs having Google crawl your more important pages. Depending on how you have these setup, you may end up sending Google into an endless loop of non-important pages to crawl 2) You are creating pages that are generally low quality, have nothing truly original on them, they will not rank for anything anyway and may give the impression that your site consists of primarily low quality pages.
What I show Google is a single simple path to browse my content. For a blog this would be a chronological listing of articles that is paginated so that Google and the user can browse from my most recent to my oldest articles. For an ecommerce page, I might setup basic category pages, make sure the category pages have great content on them and then allow Google to crawl back through all the products based on those main category pages. If I have some products in 2 or 3 categories I do not sweat it. If on either of these examples, I show the user options to resort, filter, etc the results, I block Google with a nofollow or with robots.txt.
In your example, you already have "pretty" URLs by country and town, keep those, that will let Google and your users find your content and also provide context around that content. The crazy a$$ search URL you show is handy for your PHP code to give a search result, but would just waste Google's time. Unless you think it would be useful for a user to save the search URL results, I would see if there is a way to simply hide all the parameters from the user (submit the parameters using a POST vs a GET request for example) so that all they see in the URL result is /search/search.php
Good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why am not ranking on google with 30 of domain authority
Hello my name is Alexander muller and around 2 years ago i have build this website https://muller-designs.com/ i love to use MOZ to analyze other sites, so i know that my page is better than some others but they still aut rank my website can someone give me an explanation for this ? and i also have a couple of other questions it would be great if someone can help me Is on-site optimisation really that important??? How often should I update my blog???
On-Page Optimization | | alexmuller871 -
Rel="canonical" Wordpress 2015 Best Practice
There are forum posts about how to insert rel="canonical" tags in Wordpress, but I've read about lots of changes in this space recently (updates to Yoast, for example). I'm having a problem with duplicate content on one of my sites, and it seems to be coming from multiple indexes of the same pages. I'll have a blog post show up under the posts, then the archives, then the tags. So, my question is, in early 2015, what are the current best practices for adding rel="canonical" tags in Wordpress? Thanks! Tim
On-Page Optimization | | TimLlew0 -
Disallow indexing of ALL subdomains
I'm using www.domain.com as my development hosting. Each website that i'm developing get's a temporary URL like this: project1.domain.com
On-Page Optimization | | conversal
project2.domain.com
project3.domain.com
... Now i'd like to set that ALL these subdomains can not be indexed in Google. Now I manually have to do this for each subdomain's site, and when I go online I have to change the robots.txt again. So I would like to make things a bit easier for me. Is this possible?0 -
Can't rank for a target key word "penalized?"
I've been trying to rank for the key word "kayak fishing" for my site www.yakangler.com. Last year when I started working on the SEO for my site I was on page 30 for Google search results so like the 300th result. After tweaking things on my site I managed to get to the second page but have since fallen all the way back to page 25-26 in the search results. I'm wondering if I'm penalized for this key word. I can't figure out why my site is ranking soooo badly for "kayak fishing" Any help or ideas would be greatly appreciated!
On-Page Optimization | | mr_w0 -
Difference between "And" and(!) "-"
I have a brand name "Smith and Jones". I am looking for the current best way to refer to the name in titles and text on my site. The manufactureres website is smithandjones.com . The H1 on their home page uses Smith & Jones. The 2 versions are used throughout their site. In a prior thread (http://www.seomoz.org/q/and-vs) the answer was to use nothing ie "smith jones". I was thinking that a "-" might be better since google says it tends to show a strong relationship between the 2 words. What do you think? Thanks Handcrafter
On-Page Optimization | | stephenfishman0 -
2 Duplicate pages. One Showing "/"
In SEOMoz report I have 2 pages showing that are identical in name/URL apart from the fact that one ends with the / symbol and one doesnt'. They are both showing as having too many on-page links. But one shows 106 links and the other shows 106. In clients' admin section I can only find evidence of the page without the /. I wonder if anyone could advise how best to move forward? Colin
On-Page Optimization | | NileCruises0 -
DUPLICATE PAGE VIA ONPAGE SEARCH
Hi, we have a fashion shop and we try to keep the page title as unique as possible. However google also indexes the search so the say search for brand gucci - type - dress - size 8 - then it indexes it with the homepage title rather then what the searched for. Should I block google from indexing search variation (because there could be thousand of variations) or is there a module that would use the search as a page title so gucci dress 8 for example. Many thanks for your time.
On-Page Optimization | | reallyitsme0 -
Does google treat all urls equal?
Sorry for the lame title, i couldn't think of a better one. I want to know if google treats this: http://www.domain.com/products/some-product-name the same as it would treat: http://www.domain.com/?products=some-product-name if not, could you tell me the differences?
On-Page Optimization | | adriandg0