Long urls created by filters (not with query parameters)
-
A website adds subfolders to a category URL for each filter that's selected. In a crawl of the website some of these URLs reach over 400 characters. For example, if I select shoe size 5, 5.5 and 6, white and blue colour, price $70-$100, heel and platform styles, the URL will be as follows:
There is a canonical that points to www.example.com/shoes/womens/ so it isn't a duplicate content issue.
But these URLs still get crawled. How would you handle this? It's not a great system so I'm tempted to tell them to start over with best practice recommendations, but maybe I should just tell them to block the "/filters/" folder from crawlers? For some products however, filtered content would be worth having in search indexes (e.g. colour).
-
I certainly know the feeling.
-
Completely bad Google day. Hacked universities set me off.
-
I would simply block the /filters/ folder for this client since those URLs aren't indexed (due to the canonical tag) and probably have zero links to contribute to the pagerank of the canonical page. All they're doing from a search engine's perspective is eating up crawl budget.
I understand about the color filter, however. There are several options:
- Don't worry about it. Right now it's not helping anyway since the color filter URLs rel canonical to the main category URL. If you are seeing traffic from search engines going directly into a color filter URL as a landing page from the SERPs then the canonical tag probably isn't working. If you're not seeing them as organic search landing pages, then what difference does it make, traffic-wise, if you block them?
- Create sub-categories for color if the pages are that important.
- Force the color filter to show up first in the URL and exempt it from the robots.txt block...
allow: ///filters/color/
disallow: ///filters/I'm not sure about what Travis is trying to say. Sounds like he's having a bad Google day.
-
Apparently you don't have to worry about any of that if you just hack a .edu site. XD (see screen shot - no worries, did the right thing and emailed their technical contact) Seriously though, that isn't recommended.
Mother of pearl, some of the keywords the FDU site ranks for are low competition gold. Run it through SEM Rush and have fun. I can't exactly make a strong case for any super technical theory with crap like that ranking.
The Googles.... makes my head hurt... I'm going to go cry now.
Something something... save crawl budget doing it other ways...
Something something... look at Zappos and Nike's left sidebar menus.
I quit.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Only Indexing Canonical Root URL Instead of Specified URL Parameters
We just launched a website about 1 month ago and noticed that Google was indexing, but not displaying, URLs with "?location=" parameters such as: http://www.castlemap.com/local-house-values/?location=great-falls-virginia and http://www.castlemap.com/local-house-values/?location=mclean-virginia. Instead, Google has only been displaying our root URL http://www.castlemap.com/local-house-values/ in its search results -- which we don't want as the URLs with specific locations are more important and each has its own unique list of houses for sale. We have Yoast setup with all of these ?location values added in our sitemap that has successfully been submitted to Google's Sitemaps: http://www.castlemap.com/buy-location-sitemap.xml I also tried going into the old Google Search Console and setting the "location" URL Parameter to Crawl Every URL with the Specifies Effect enabled... and I even see the two URLs I mentioned above in Google's list of Parameter Samples... but the pages are still not being added to Google. Even after Requesting Indexing again after making all of these changes a few days ago, these URLs are still displaying as Allowing Indexing, but Not On Google in the Search Console and not showing up on Google when I manually search for the entire URL. Why are these pages not showing up on Google and how can we get them to display? Only solution I can think of would be to set our main /local-house-values/ page to noindex in order to have Google favor all of our other URL parameter versions... but I'm guessing that's probably not a good solution for multiple reasons.
Intermediate & Advanced SEO | | Nitruc0 -
URL structure for am International website with subdirectories
Hello, The company I am working for is launching a new ecommerce website (just a handful of products).
Intermediate & Advanced SEO | | Lvet
In the first phase, the website will be English only, but it will be possible to order internationally (20 countries).
In a second phase, new languages and countries will be added. I am wondering what is the best URL structure for launch: Start with a structure similar to website.com/language/content (later on we will add other languages than english) Start with a structure similar to website.com/country/content
3) Start with a structure similar to website.com/country-language/content (at the beginning it will be all website.com/country-en/content) What do you think? Cheers
Luca0 -
Trailing Slashes on URLs
Hi we currently have a site on Wordpress which has two version of each URL trailing slash on URLs and one without it. Example: www.domain.com/page (preferred version - based on link data) www.domain.com/page**/** The non-slash version of the URL has most of the external links pointing to them, so we are going to pick that as the preferred version. However, currently, each version of every URL has rel canonical tag pointing to the non-preferred version. E.g. www.domain.com/page the rel canonical tag is: www.domain.com/page/ What would be the best way to clean up this setup? Cheers.
Intermediate & Advanced SEO | | cathywix0 -
Can we put long-tail keywords at footer menu and create landing pages for same?
When we cannot rank for multiple keywords; can we try creating landing pages for some long-tail keywords and put all such landing pages at footer menu to rank for search queries? Will this helps and sound spammy to Google?
Intermediate & Advanced SEO | | vtmoz0 -
Ecommerce - Go to Basket 302 query
Hi I have done a site crawl and there are a lot of 302's on the 'Go to Basket' link when customers go through to pay. Should these be updated to 301's? On just the first part of the link so nothing after the ? /OrderCalculation? Thank you
Intermediate & Advanced SEO | | BeckyKey0 -
Site penality revoked but no movement? how long?
its now more the 30 days since google revoked the manual link penalty and still no movement in the serps I am sitting around position 350 for something I should naturally site on the first several pages.. another thing I wanted to point out, the keyword that I'm ranking 350+ for is my domain name without the .extension ( i.e. .com ) How long should I wait, or have they forgotten to remove the penalty. Thanks,
Intermediate & Advanced SEO | | Robdob20130 -
How to create SEO budget?
If I see the site which has 8,000 links from unique domains (RDD in Market Samurai). How much could it cost to build such amount of links? How long does it take? What SEO budget will be based on these data?
Intermediate & Advanced SEO | | rboychuk0 -
Does URL format affect Keyword effectiveness for a URL?
I am looking at our site structure, and don't want to have to rebuild the way the site was linked together based on it's current folder structure so I am wondering what option would work better for our URL structure. I will uses car categories as an example of what I am talking about, but you can insert any category structure you like. For example I would like to have pages like this: www.example.com/ford-convertibles
Intermediate & Advanced SEO | | SL_SEM
www.example.com/chevy-convertibles But instead due to the site structure I will need to have pages like this: www.example.com/ford/convertibles
www.example.com/chevy/convertibles But wonder if I shouldn't do the following to ensure the proper phrase is known for the page: www.example.com/ford/ford-convertibles
www.example.com/chevy/chevy-convertibles The "/ford/ford-convertibles" just seems odd to me as a human, but I haven't seen anything on how well a keyphrase in a URL split by /'s does and I know dashes for phrases are fine. This means I am inclined to go with the"/ford/ford-convertibles"style because it keeps the keyphrase separated by dashes even if it is a bit repetitive. There will be other pages too like "/ford/top-10-fords-ever" but I don't wonder about that since it isnt "ford/ford-xxxxx" Thoughts on whether /'s in a keyphrase are as good as dashes?0