Google Crawl Errors from vbseo change
-
We have vbseo setup on our site and for some reason a setting was changed unexpectedly and was un-noticed where it changed the URL of all the pages and so none of our pages were getting indexed by google any longer due to 401 errors. Most of our SE traffic fell off.
We discovered the issue a couple weeks ago and we changed the setting back so that the URLs are the same as they were originally before but in Google webmasters it's still showing crawl errors and our search engine traffic hasn't recovered at all. We have sitemaps being sent daily.
-
That would seem a bit longer than I would have expected. I would consider adding 301 redirects for all of the "temporary" pages so that those point back to the original/current pages.
-
Thanks for the feedback. We made the change about 5-6 weeks ago and still not seeing a recovery but the number of links indexed. Here's a screenshot of the drop and non-recovery.
-
You'll find that Google will keep retrying those broken links for months. The frequency will go down, and eventually they'll stop trying.
In the meantime, the changed URLs undoubtedly made a mess of Google's calculations for internal link juice, and you should expect it to take about a month for that to settle back to normal as well.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How long does Google take to reduce the index size?
A few months ago, we have incorporated our custom search in our website www.ergodotisi.com . We hadn't been paying a lot of attention to our webmaster analytics, to find out a few months later than the Google Index had grown from 2K- 3K pages to one million because it was crawling all combinations of search filters. We have now followed the right instructions to add noindex meta tags and blocked most search result pages from the robot.txt. We allow indexing of some main categories by setting new seo-friendly url structures. A few weeks have passed and the index size has only reduced to 700K. How long does it take before it removes most of the duplicated search result pages from the index? Is it still crawling those pages but has not fully decided to remove most of them? How bad is this for SEO?
On-Page Optimization | | cplastiras840 -
Is there a benefit to hiding words from Google on ecommerce sites?
I think we all know that ecommerce sites have a lot of repeating functional texts on them. Is there a benefit from hiding this text from Google's crawler? Take this page for example, http://storage3.static.itmages.com/i/16/0805/h_1470425505_1090542_224cc344d4.png Some of the most dense words on the page are "Add to cart", "Add to Wishlist", "New", and "Sale". Is there any benefit to hiding those words from Google? The method of hiding I am talking about is not cloaking, but this, https://www.google.com/support/enterprise/static/gsa/docs/admin/70/gsa_doc_set/admin_crawl/preparing.html#1076243 using the google:off index tag. So the content will be there still, but it will not be indexed.
On-Page Optimization | | LesleyPaone0 -
Google vs. Bing
We are having some really good results with our SEO strategies for local search and long tail searches for our clients on Google; however, Bing is a completely different story in a couple of cases. What is Bing looking for that Google is not? We have even noticed that something may rank well in Bing then not show up at all in Google? Any help would be greatly appreciated.
On-Page Optimization | | Strategexe0 -
Ajax url returns an error by google. Is there another way besides creating a HTML version?
We trying to find out if there is anything to make it so google does not keep returning errors cuase of our ajax urls. Is there any other option besides creating it all in a HTML format for google to read? Any tips or help would be great!
On-Page Optimization | | DoRM0 -
What is causing Bing and Google Rankings to Differ by so much?
Does anyone know the trick to have Google Rankings to be as good as Bing/Yahoo Results?
On-Page Optimization | | hfranz0 -
SEOmoz crawl error
Hi, I'm getting a crawl error and it complains about there being missing meta description... But, the errors are all for non existent index files in directories that only contain pdf files and some thumbs of the front page... Just started trying to learn this stuff...! Cheers Rod
On-Page Optimization | | DrWho0 -
Why isn't Google indexing me?
Recently got handed off a .org site for a quasi state agency here in Michigan. Turns out the developer had the site live for the past six months but left the noindex, nofollow tag on everything so the site was invisible to search engines. Obviously we wiped all of those things a couple weeks ago when we got started, added all of our sitemaps to bing/yahoo/google webmaster tools and we've already started getting indexed by yahoo and bing and showing up for branded terms...but NOTHING from Google. WMT says our pages are all indexed, but we aren't showing up for anything in search and we don't seem to be indexed at all. Granted, if this site was brand new and didn't have any links I could see us taking a little time to get found, but this site has very good .gov and .edu links, plus we've built some other solid links to it since we've launched and Google continues to ignore it. I haven't seen this before, but could Google still be ignoring us from the months of noindex, nofollowing? If so, any tips on how to get back in teh Google's good graces here?
On-Page Optimization | | NetvantageMarketing0 -
Google webmaster tools data update frequency?
What is the lag time for changes to a site to be reflected in Google webmaster tools Diagnostics section? They pointed out some duplicate titles which I fixed a week ago and yet they still show up as an HTML Suggestion. What has your experience been with making changes and then seeing them reflected in the HTML Suggestions section? My site is crawled every day, including the pages I have updated with new titles. Seems like it takes a while for the data to trickle into Webmaster tools, no?
On-Page Optimization | | scanlin0