Overly-Dynamic Urls how to fix in SEOMOZ?
-
Hello.
I have about 300 warnings of overly-dynamic urls.
In urls like this:
http://www.theprinterdepo.com/clearance?dir=asc&order=price&p=10
As you can see all parameters are needed, and my ecommerce solution generates them automatically.
How can I get rid of these warnings? I suppose that by using robots.txt, but I have no idea about it.
In my google webmaster tools I have already configured that these parameteres the crawler should not index them.
Check the image here:
-
Hi Kami,
You might want to ask this in a new post. New posts on old threads don't bump a post in the Q&A forums, so not too many people will see this post (I only knew about it as I was notified from having subscribed last year).
-
Hi, We sort of have the same issue, We have over 5000 pages with the same issues actually. Our ecommerce site uses several different filter (Using Ajax) and we have many different urls like,
http://www.dellamoda.com/Designer-Pumps.html?sort=price&sort_direction=1&use_selected_filter=Y
http://www.dellamoda.com/Designer-Accessories.html?sort=title&use_selected_filter=Y&view=all
http://www.dellamoda.com/Designer-Accessories.html?sort=title&sort_direction=1&use_selected_filter=Y
Could we use the robots.txt file to disallow these as well? and do we need to put the whole url in there?
like:
Disallow: /*?sort=price&sort_direction=1&use_selected_filter=Y
if not how far into the url should be disallowed?
Any help would be greatly appreciated.
Thank you, Tony
-
John, having a ton of URLs indexed for the same page will actually dilute things, not help your rankings. Dr. Pete wrote a great post at http://www.seomoz.org/blog/duplicate-content-in-a-post-panda-world explaining duplicate content that should help give you a better understanding of things.
-
Hello there,
I have encounter a similar problem in a similar scenario. If we do not allow this pages to be crawled, wouldn't it reduce the number of pages indexed resulting in lower Google ranking?
-
Hi! Did Rasmus answer your question, or are you looking for some more help?
-
Disallow: /*?dir=desc
Disallow: /*&order=
I think yout should try with these lines, and test in Google Webmaster tools. This should leave only this page
https://www.theprinterdepo.com/clearance
That is what you want right?
-
Can I know the syntax for robots.txt to ignore those?
-
Sure thing!
For example:
<a <span="">href</a><a <span="">="</a>https://www.theprinterdepo.com/clearance?dir=desc&order=price" title="Set Descending Direction">src="https://www.theprinterdepo.com/skin/frontend/default/MAG060062/images/i_asc_arrow.gif" alt="Set Descending Direction" class="v-middle" />
This code is the code for reversing the result. So you can check to see if the page has a url query with "dir=asc" (the standard). If so the code above should instead be:
<a rel="nofollow" <span="">href</a><a rel="nofollow" <span="">="</a>https://www.theprinterdepo.com/clearance?dir=desc&order=price" title="Set Descending Direction">src="https://www.theprinterdepo.com/skin/frontend/default/MAG060062/images/i_asc_arrow.gif" alt="Set Descending Direction" class="v-middle" />However, I believe the best approach will be to change the meta tag for robots for the page.
if the url query is dir=asc, order=price then robots="index, follow". If dir is not asc, and order is not price then robots="noindex, follow".
-
I am a really newbie to SEO, can you please explain me how to do it?
-
Can you either set rel="nofollow" on the links on the page that changes the sorting, such that moz and google do not check these pages? Or you can set the robots="noindex, follow" on pages which are not the "standard" sort?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
URL Parameters for Product Variation
Hey there Mozzers, So I have a website that uses URL Parameters for product variations. So for example when I am in the product "test" that product has 5 different variations. So the url is as followed /product/test /products/test?variant=10271886529 /products/test?variant=10271886530 etc. Does Google understand that this is the same page ? Does it automatically exclude the variable in the url?
Technical SEO | | AngelosS0 -
Dynamic vs. static URLs
Hello Everyone, I'm new here on MOZ and just getting back into SEO (a little bit) after not doing anything 'myself' for a couple of years. Currently my individual URLs show as: https://www.example.com/index.php?l=product_detail&p=107 (dynamic responsive site). I can switch it to a static site, so the individual product pages read as:https://www.example.com/catalog/category name/product name-107.html It's still a long URL, but it would be keyword rich. Some of my current dynamic pages are indexed,and due to an upgrade I had to do several months back, I already have some redirects (301) from my php extensions to the one listed above. This is my long explanation to my following questions: Does having a dynamic or static site matter when ranking in search engines I already have some redirects coming my older site to this dynamic site, so I would have to make more directs from the dynamic site to my static site - is this okay to do? I'm really at a loss, a couple of years ago, I ranked 1-3 (on Page 1) on Google for all my keywords, (all White Hat work), and now I'm into great abyss of no mans land of the internet (ranked on Page 3+) Thank you for any and all help from everyone! ~Sandra
Technical SEO | | rankmenow0 -
URL Structure Question
We are building a job board website that will have a decent amount of "career resources" type content and want to make sure we set up our url structure correctly. After researching on Google and here I have an idea how to structure it but would like some insight if we are on the right track. We are using Wordpress for the content part of our website. We will have about 5 content categories (like resume-tips, job-interviews, job-search etc.) The two options we are considering; www.domain.com/career-resources/index.html As content start page www.domain.com/career-resources/resume-tips/index.html category start page www.domain.com/career-resources/resume-tips/top-5-resume-mistakes.html article name is the /career-resources/ folder really needed or can we go something like; www.domain.com/career-resources/index.html As content start page www.domain.com/resume-tips/index.html category start page www.domain.com/resume-tips/top-5-resume-mistakes.html article name Are we on the right track... and is one way better for SEO that the other? Thanks! Shaun
Technical SEO | | aactive0 -
URL redirecting domains
Hi Is there anything wrong/dangerous forwarding a clutch of domains to a sub page (landing page) on a different domain ? Say Brand X buys Brand Z and wants to close down Brand Z site but have Brand Z domain fwd to a landing page (explaining the company acquisition) on Brand X site. In addition Brand Z had a few related but unused domains forwarding to Brand Z doman & now also wants those fwd'd to the new landing page on brand X Since the reasons for doing this forwarding are legitimate company reasons relating to an acquisition i would have thought it should be ok but can anyone think of a reason why could be bad since i remember in the old days peeps used to redirect domains for seo reasons so worried fwd'ing a load of domains could cause some sort of negative flag with big G ? Also do domain redirects transfer the authority/juice from the old site/domain to the new destination page (new landing page on brand x site) similar to how a 301 redirect works ? Many Thanks Dan
Technical SEO | | Dan-Lawrence0 -
How do I fix a multiple domain mess?
I just picked up an account that is a franchisee and they have 6 exact match domains plus their main domain (all exact duplicates, not 301s). GA shows the main domain as getting the lion's share of hits, but for some important local keywords, the exact match domains rank higher. Some pages may have the exact match domain, primary domain and the franchise domain all ranking on the same SERP. Yuk! My strategy is to work on the main domain and as the work progresses, the main site will surpass the exact match domains and main franchise domain for the important searches. For the exact match domains I plan on just leaving them alone. Is this a sound strategy? I could pull the exact match domains down, but since they rank well for their keywords, it seems most sensible to leave them up. What do you think?
Technical SEO | | KristinnD0 -
Can you 404 any forms of URL?
Hi seomozzers, <colgroup><col width="548"></colgroup>
Technical SEO | | Ideas-Money-Art
| http://ex.com/user/login?destination=comment%2Freply%2F256%23comment-form |
| http://ex.com/user/login?destination=comment%2Freply%2F258%23comment-form |
| http://ex.com/user/login?destination=comment%2Freply%2F242%23comment-form |
| http://ex.com/user/login?destination=comment%2Freply%2F257%23comment-form |
| http://ex.com/user/login?destination=comment%2Freply%2F260%23comment-form |
| http://ex.com/user/login?destination=comment%2Freply%2F225%23comment-form |
| http://ex.com/user/login?destination=comment%2Freply%2F251%23comment-form |
| http://ex.com/user/login?destination=comment%2Freply%2F176%23comment-form | These are duplicate content and the canonical version is: http://www.ex.com/user (login and pass page of the website) Since there were multiple other duplicates which mostly have been resolved by 301s, I figured that all "LOGIN" URLs (above) should be 404d since they don't carry any authority and 301 those wouldn't be the best solution since "too many 301s" can slow down the website speed. But a member of the dev team said: "Looks like all the urls requested to '404 redirect' are actually the same page http://ex.com/user/login. The only part of the url that changes is the variables after the "?" . I don't think you can (or highly not recommended) make 404 pages display for variables in a url. " So my question is: I am not sure what he means by that? and Is it really better to not 404 these? Thanks0 -
Block url with dynamic text in
I've just ran a report and I have a lot of duplicate page titles, most of which seem to be the review page, I use Magento and my normal url would be something like blah-blahtext.html but the review url is something like blah-blahtext/reviews/category/categoryname So I want to block the /reviews url bit as no one ever leaves reviews and it's not something I will be using in the future. Also I have a dynamic navigation which creates urls that look like product-name.html?size=2&colour=14 these are also creating duplicate urls, anyway to fix this? While I'm asking, anyone any tips for Magento?
Technical SEO | | Beermonster0 -
Dynamic Parameters in URL
I have received lots of warnings because of long urls. Most of them are because my website has many Attributes to FILTER out products. And each time the user clicks on one, its added to the URL. pls see my site here: www.theprinterdepo.com The warning is here: Although search engines can crawl dynamic URLs, search engine representatives have warned against using over 2 parameters in any given URL. The question to the community is: -What should I do? These attributes really help the user to find easier the products. I could remove some of the attributes, I am not sure if my ecommerce solution (MAGENTO), allows to change the behavior of this so that this does not use querystring parameters.
Technical SEO | | levalencia10