CMS dynamicly created pages indexed?
-
Hey Moz'erz,
Looking at the indexed pages of my clients eCommerce website I noticed that dynamically created pages are being indexed.
For example this page does not "exist" but is created by a drop down filter menu that sorts by product tag:
/collections/tools/TAG
I can only conclude that this page got indexed either through a backlink or once upon a time there was an internal link pointing to this URL and got indexed (currently there is not). Are either of these cases possibilities?
In either case before considering removal or any action I would of-course reference analytics to check for conversions, traffic and any backlinks for those "pages".
I believe at the end of the day is recommend a drop down filer that doesn't create new pages as the best solution.
Thoughts, comments and experience is greatly welcomed
-
Hey Dylan
Either of those are possibilities for Google finding and indexing a page like that. There could be many ways that happened - I've seen them spider "links" in a drop down depending on how it's implemented.
One thing you can do to check how, is looked at the text-only cache of the page (type cache:www.domain.com/page-name in your browser and click text only) - and look to see if the drop down items actually appear and clickable links. You can also try crawling the site with Screaming Frog and set the user-agent to GoogleBot and see if they got picked up.
If the filter is just for example re-sorting the list of items in a category, there is probably not a need to have this crawled or indexed, because it's just the same content in a different order.
If you do want to remove them from the index, you will want to add a meta noindex tag to the HTML, wait for them to drop out of the index, and then block crawling with robots.txt or nofollow the links that might be generated.
Hope that helps!
EDIT - I'd also check to be sure they are not showing up in your XML sitemap.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Internally linked pages from different subdomain must be well optimised?
Hi all, We have guide/help pages from different subdomain (help.website.com). And we have linked these from 3rd hierarchy level pages of our website (website.com/folder1/topic2). But help.website sumdomain & pages are not well optimised. So, I am not sure linking these subdomain pages from our website pages hurts our rankings? Thanks,
Web Design | | vtmoz0 -
We redesigned our website, make it responsive and page views tanked. What happened?
Last year, we redesigned our site and made it responsive. Our page views only grew by only 3% (the previous year they grew by 40%). If we exclude homepage views from our calculations, we get a drastically different picture-- and see over 30% growth for both total and unique pageviews. Any thoughts?
Web Design | | Anna720 -
How to create Google Section or Jump To Links
Hello all! i need create a jump to links on my site and when seach a keyword on google it will display jump to links http://techwyse.com/blog/wp-content/uploads/2009/12/google-jump-to-links.jpg i same with that images please help me how to do it, and have any plugin on wordpress can do that google-jump-to-links.jpg
Web Design | | ITVSEO.COM0 -
Joomla ( title page override not working properly ) any techy guys out there
Hey Mozzers I am having some problems with joomla. I have tried many support forums and since everyone is in the same field as me, i thought this would be a great place to ask this question. I am working with joomla 2.5 and After i have turn on my search engine friendly configuration, you can override the ( alias ) of the page by providing page display options for title tag. so i turned on the SEF in global config and turn on the mod-rewrite and made sure my htaccess file was not txt. But i am having some problems with this.
Web Design | | BizDetox
On some pages the page display option for the _browser page title _works and on some it does. On the pages it doesnt it is pulling the information of the Alias. ( which is common with most site )
Why is it doing this You can check out the pages yourself Here is a page with it not working
http://tungstengem.com/mens-wedding-bands and here is a page with it working
http://tungstengem.com/mens-wedding-...-bands-for-men Also for my homepage when i didnt have my Apach rewrite it show the index.php and i was able to ad an alias to it. Now the Alias for the home page is not working0 -
Transitioning to a dynamic home page. Impact on SEO?
Home page redesign advice, please. We're a growing college textbook publishing company; a unique one in that we publish everything under an open license. Our homepage www.flatworldknowledge.com has a solid page score (80), and since our product serves several different customers/audiences -- students, faculty, bookstores -- we're transitioning to a dynamic home page approach. Returning instructors will be served a personalized faculty page, returning students a student oriented page featuring the books they've most recently accessed, and first time/anon visitors will receive a more neutral welcome page until we know more about them. Pros, cons with this change to a dynamic homepage? What should we be thinking about/concerned about from an SEO perspective? How do you address title tags? Will this approach dilute page authority? Thanks all!
Web Design | | JasonBilog0 -
My personal search page
www.myname.com I watched the "White Board Friday" video on creating your own website based on your name. Can anyone explain why this would be a good concept for me? I'm currently involved in 1. Marketing for the company I work for 2. Sales for the company I work for 3. Affiliate Marketing/ Site Creation as side projects 4. SEO as a free-lance part-time offering 5. PPC & Web-marketing as a free-lance part-time offering Would my personal page be to showcase all of this? why is it beneficial for SEO?
Web Design | | AndySolo0 -
Too Many On-Page Links
Most of my pages have "Too Many On-Page Links". If you view the website you will see this is mainly down to the top navigation drop down menu: http://www.cwesolutions.co.uk So if I wanted to reduce the number of links I would have to have category links with landing pages. How much does having "Too Many On-Page Links" effect my website ranking? Is it really important and would I notice a difference if I changed it?
Web Design | | petewinter0 -
Which CMS Should Use?
I have a desinger working on a new webiste and he's suggesting that WP creates design limitations (He's doing quite a bit of HTML 5 I believe...I'm not sure) and obviosly has secruity concerns. He suggested TextPattern, which I've never heard of. Has anyone had any experience with it? Also, what CMS are you using (besides WP) that you really like and is SEO friendly? Thanks
Web Design | | LuminConsutling0