Search directory - How to apply robots
-
Hi.
On the site I'm working on, we use a search directory to display our search results. It displays as follows -
With the dynamic search results appearing after the hash tag.
Because of the structure of the website, many of the lefthand nav defers back to this directory. I know that most websites "noindex, nofollow" the search results pages, but due to the ease of customers generating them, I'm afraid that if I do this, we'll miss out on the inevitable links customers will provide...and, even though it's just the main search directory, these links will still help my domain. The search is all java-generated so there's nothing for spiders to follow within this directory - save the standard category nav.
How should I handle this?
Thanks.
-
That was my first instinct as well - but I wanted to check if there was a better move? Thanks for your help!
-
Have you considered switching to simply "noindex, follow" for these pages? This would both keep them out of the search index and would allow for the benefit of external links to these pages.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Directory website creation
Hi, I'm in the process of helping a client with a wedding show & supplier directory. Could anyone give me pointers as to the best practice for the architecture? Because the suppliers and shows will be listed geographically is there a possibility for the site to seem keyword stuffed? thanks, MOZ brain, you guys always rock.
Web Design | | Libra_Photographic0 -
Is there anything wrong to have large number of internal links pointing to homepage? Including links from sub domains or sub directories?
Hi all, Generally more number of internal links will be pointed to homepage. But I see some modern suggestions that too many internal links to homepage are not good. I'm just wondering if most number of internal links pointing to homepage may hurt? Also we have sub domains, can we point a link from every page of sub domain or sub directory to homepage? Usually the answer here is about users. Of course, the content is about same product across all pages. Thanks
Web Design | | vtmoz0 -
Creating Multiple Sub-Directories in Wordpress
Hi fellow Mozzers, I'm currently in the process of planning/building a website for e-commerce and have stumbled on a bit of a hurdle with sub-directories. I want to use a piece of software called SellerDeck to generate my e-commerce store and also my homepage (index.html). This element of the build is fine as the e-commerce store will sit in a sub-directory of .co.uk/store/. What I'm struggling with is the rest of the site architecture. I want to use Wordpress to manage content for the rest of the site. I want to have sub-directories .co.uk/help/ and .co.uk/blog/, all managed from one Wordpress installation. Is this possible? If not, does having two separate installations of Wordpress create any speed issues? Additional question for bonus points from me; lets say I wanted to do away with sub-directories for the /help/ and /blog/ elements (but keep the /store/), could I have a Wordpress installation that doesn't generate a homepage (index.php) so I can utilise the e-commerce software version instead. Essentially I'd be installing Wordpress at the root folder, but wouldn't have an index.php made by Wordpress. Many thanks in advance
Web Design | | BlueTree_Sean0 -
The impact of using directories without target keyword on our Rankings
Hello all, I have a question regarding a website I am working on. I’ve read a lot of Q en A’s but couldn’t really find the best answer. For one of our new websites we are thinking about the structure of this website and the corresponding URL-structure. Basically we have a main product (and a few main keywords) which should drive the most traffic to our website, and for which we want to optimize our homepage. Besides those main keywords, we have an enormous base of long-tail keywords from which we would like to generate traffic. This means we want to create a lot of specific pages which are optimized. My main question is the following: We are thinking of two options: Option 1: www.example.com/example-keyword-one Option 2: www.example.com/directory/example-keyword-one With option 1 we will link directly from our homepage to the most important pages (which represent our most important keywords). All the pages with the long tail content will be linked from another section on our website, which is one click away from our homepage (specifically a /solutions page which is linked from the footer). All the pages with long-tail content will have this structure www.example.com/example-keyword-one so the URLs will not contain the directory /solutions With option 2 we will use more subdirectories in our URLs. Specifically, for all the long tail content we would use URLs like this: www.example.com/solutions/example-keyword-one
Web Design | | NielsB
The directories we want to use wouldn't really have added value in terms of SEO, since they don’t represent important keywords. So what is the best way to go? Option 1, straightforward, short URL’s which don’t really represent the linking structure of our website, but only contain important keywords. Or option 2, choose for more directories in our URLs which represent the linking structure of our website, but contain directories which don’t represent important keywords. Would the keyword ‘solutions’ in the directory (which doesn’t really relate to the content on the page) have a negative impact on our rankings for that URL?0 -
Getting a highly ranked site a better result for 1 search term
I have a highly ranked website for a niche category. My site ranks higher in SEOMOZ than all of my competitors, but I can't get any higher than 4th on a page for one specific search term. What can I do to help my site increase its ranking on a specific search term?
Web Design | | tadden0 -
Any reaction to the announcement from Google that 'signed in' searches won't pass through search query info to analytics?
Seems like SEO is about to get that much harder: http://analytics.blogspot.com/2011/10/making-search-more-secure-accessing.html Any thoughts on this?
Web Design | | PaulM011 -
How do search engines interpret <hgroup>...</hgroup> tags?
Hi there. I'm building an HTML 5 site and through research of new HTML 5 elements I've seen little conclusive information about the interpretation of the new <hgroup>tag, in terms of SEO application and interpretation. In particular does Google interpret the nested heading tags as individual elements or does it combine them into one entity? For example, say I have: <hgroup> # Article Heading ## Article Sub-heading </hgroup> How is this interpreted by Google and what would be some good SEO best practices regarding the <hgroup>tag in HTML5: Is it interpretted as a single tag (" Article Heading: Article Sub-heading ") or two separate heading tags (one and one )? Also, how much does the ordering of the tags matter (say for example I wanted something like the following for visual purposes? <hgroup> ## Article Sub-heading # Article Heading </hgroup> One last thing: is it safe to assume that it is indeed OK to have multiple tags on a single page (as referenced by Matt Cutts a while back in a Webmaster Video)? Thanks! </hgroup> </hgroup>
Web Design | | LMDNYC2 -
Page Title or Search Friendly Urls?
We are currently auditing our website as part of our SEO strategy. One item which hascome up is the importance of search friendly urls against the search engine friendly page titles. Do url's or page titles carry more relevance than the other in search engines? Obviously the ideal would be to have both to maximise search impact but do either carry more importance. Thanks
Web Design | | bwfc770