Should I care about this Webmaster Tools Message
-
Here is the message:
"Googlebot found an extremely high number of URLs on your site: http://www.uncommongoods.com/"
Should i try to do anything about this? We are not having any indexation issues so we think Google is still crawling our whole site. What could be some possible repercussions of ignoring this?
Thanks Mozzers!
-Zack
-
Hi Zack,
Just checking in to see if you had run any other tests to determine why this message might have appeared (e.g. a site crawl to find duplication / bad canonicalisation, etc.)? Let me know if you still need assistance.
Cheers,
Jane
-
Also agree with David, but it wold not hurt to ensure that your XML sitemaps are up-to-date and an accurate reflection of your site's content. It also does not hurt to clean up any potential duplicate URL issues that your site may have. Otherwise you do not need to put a lot of weight into this message from GWT.
-
David is spot on aobut the titles and urls. Large DB driven sites tend to cause big issues off of simple mistakes in coding or content entry.
I have to say "Crawl it" again.
-
Since it is an ecommerce store with a lot of products, its natural for you to have a lot of URLs. As long as your content, titles, and urls are unique, I wouldn't pay a lot of attention to it.
Did a site search, and it came up with "About 181,000 results" that were indexed. If you know that number to be excessive, I would begin checking to see if you have cms generated URLs, that may be causing such a high page count.
-
I would crawl the site and look for and spider traps or potential duplicate content. I make it a point to do so every time I see one of these notices and I have found things after these notices that could potentially or havecontributed to a Panda filter.
Although I do recommend at least weekly crawls on larger sites, these notices area good prompt to do it if you have been lax on your audits.
-
If Google sends you a message, I'd listen.
Generally, these messages comes when you don't have something set correctly in your parameters. Have you set canonicals for your items?
Here are some resources to go through.
From Google: https://support.google.com/webmasters/answer/76401?hl=en
A Good Product Forum Discussion: https://productforums.google.com/forum/?hl=en#!category-topic/webmasters/crawling-indexing--ranking/CCORJBI-mEg
A Good Product Forum Discussion that has John Mueller (works for Google) on it: https://productforums.google.com/forum/#!topic/webmasters/1aTAjsRbIOU
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is anyone aware about a tool that can be used for tracking YouTube video ranking on SERP & YouTube?
I am looking for a tool that can track ranking position of a YouTube video on SERP and YouTube. An example would be, Suppose I have a video X. I want to know the position of the video for keywords A,B,C on SERP and YouTube. Do let me know your inputs.
Intermediate & Advanced SEO | | SameerBhatia0 -
Completely redesigned webmaster - set up new site in Google Webmaster Tools, or keep existing??
Hi - our company just completely redesigned our website and went from a static HTML site to a PHP based site, so every single URL has changed (around 1500 pages). I put the same verification code into the new site and re-verified but now Google is listing tons and tons of 404's. Some of them are really old pages that haven't existing in a long time, it would literally be impossible to create all the redirects for the 404s it's pulling. Question - when completely changing a site like this, should I have created a whole new Search Console? Or did I do the right thing by using the existing one?
Intermediate & Advanced SEO | | Jenny10 -
Tools to scan entire site for duplicate content?
HI guys, Just wondering if anyone knows of any tools to scan a site for duplicate content (with other sites on the web). Looking to quickly identify product pages containing duplicate content/duplicate product descriptions for E-commerce based websites. I know copy scape can which can check up to 10,000 pages in a single operation with Batch Search. But just wondering if there is anything else on the market i should consider looking at? Cheers, Chris
Intermediate & Advanced SEO | | jayoliverwright0 -
GWT URL Removal Tool Risky to Use for Duplicate Pages?
I was planning to remove lots of URL's via GWT that are highly duplicate alike pages (similar pages exist on other websites across the web). However, this Google article had me a bit concerned: https://support.google.com/webmasters/answer/1269119?hl=en I already have "noindex, follow" on the pages I want to remove from the index, but Google seems to take ages to remove pages from index, which appear to drag down unique content pages from my site.
Intermediate & Advanced SEO | | khi50 -
Help needed on Google Webmaster tools
Hi I notice that one of my oldest sites , even if I put hundred of backlinks (good or bad) google webmaster tools never index more like 20 per day. Why is this happening? They control it? I mean they dont let them all to get indexed and they take it slowly slowly? If I put just 20 per day is the ideal link building amount? Thnk you
Intermediate & Advanced SEO | | nyanainc0 -
XML Sitemaps for Message Boards / Forums - Best Practices?
I'm working with a message board that has been around for 10+ years and never taken SEO best practices into consideration. They recently started seeing mobile URLs show up in regular results, which they don't want. I'm recommending they implement multiple sitemaps to properly indicate to Google how to crawl the site and what to index. I've never dealt with a site this large so I'm not sure best practices. They have a HUGE community and new URLs are created every second. Doing a site: search returns "About 12,100,000" URLs. What are some best practices / the best way to approach sitemaps for a site of this size?
Intermediate & Advanced SEO | | MichaelWeisbaum0 -
Webmaster Index Page significant drop
Has anyone noticed a significant drop in indexed pages within their Google Webmaster Tools sitemap area? We went from 1300 to 83 from Friday June 23 to today June 25, 2012 and no errors are showing or warnings. Please let me know if anyone else is experiencing this and suggestions to fix this?
Intermediate & Advanced SEO | | datadirect0 -
Penalized for "Unnatural Links" on Webmaster Tools
Has anyone ever logged in to Google Webmaster tools and seen a message about them seeing unnatural links (as a warning) Our homepage lost all its rankings. I will submit a reconsideration request. We don't engage in link buying practices (some directories, thats all.) Any feedback, please? Thanks
Intermediate & Advanced SEO | | PaulDylan0