A Serious drop in Pages crawled per day
-
On 21st April ,I spotted a sudden decrease in pages crawled per day.Previously it was about 5,000 bust after the drop it reached to 225.From the crawl rate never spiked.
Here is my website url - http://www.wpstuffs.com/
-
What strikes me is at the same time as your pages crawled fell off a cliff your page load time doubles. What changed round about then that would have caused an increase in load times?
If that was around the time you switched CDN, I'd be double and triple checking the new one was set up perfectly and is an improvement on cloudflare. Did all your pages suddenly get markedly bigger, perhaps due to another plugin being added? Pingdom tools is also great for picking apart load times.
That would be where I'd start...
-
Iam using WordPress blogging platform and checked the GWT and Analytics but there were no break in code.
Im using Google Pagespeed CDN service ? will that cause such problems.Previously I was using Cloudflare.
Current PageSpeed is 92 and load time is under 3seconds.I checked the pingdom report and it doesn't show any down time stats.
-
Yes, well there are a couple of things to consider and test.
First and foremost, check your GWT code and make sure that nothing's change. Same with Google Analytics.
Have you changed platforms?
If not, I would say it's "Hoy Crap Batman" time and you need to start analyzing everything. What's your Pagespeed? Is your site online? If so, was it offline earlier in the week? (Maybe you weren't checking every minute) If your site is hosted by someone else, get on the phone and demand some answers.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Anyone suspect that a site's total page count affects SEO?
I've been trying to find out the underlying reason why so many websites are ranked higher than mine despite seemingly having far worse links. I've spent a lot of time researching and have read through all the general advice about what could possibly be hurting my site's SEO, from page speed to h1 tags to broken links, and all the various on-page SEO optimization stuff....so the issue here isn't very obvious. From viewing all of my competitors, they seem to have a much higher number of web pages on their sites than mine does. My site currently has 20 pages or so and most of my competitors are well in the hundreds, so I'm wondering if this could potentially be part of the issue here. I know Google has never officially said that page number matters, but does anyone suspect that perhaps page count matters towards SEO and that competing sites with more total pages than you might have an advantage SEOwise?
Algorithm Updates | | ButtaC1 -
Does Google giving more important to internal pages than homepage recently? Especially after the recent Major algo update?
Hi everybody, I can see the change Google brought in the SERP. Previously website homepages will be shown for primary keywords, now it's slowly and almost switched to showing most related internal pages in a website. You can check same for keyword "SEO", Most or all the results are internal pages. I can see this change for our primary keyword from last one month. So basically Google is trying to show a page explaining about the primary keywords rather than website, that's how "what is seo" pages are ranking than homepages. If there is no such pages existed or not well written, Google is just showing the website homepage. But I noticed that websites ranking with homepages are dropped compared to the websites with dedicated page about that primary keyword. Please share your thoughts. Thanks
Algorithm Updates | | vtmoz0 -
Google Search Analytics desktop site to losing page position compared to the mobile version of the site
Looking at Google Search Analytics page position by device. The desktop version has seen a dramatic drop in the last 60 days compared to the mobile site. Could this be caused by mobile first indexing? Has Google had any releases that might have caused this?
Algorithm Updates | | merch_zzounds0 -
Website and landing pages - Proportionate authority
Does website's (homepage) ranking going to influence landing pages ranking or vice-versa? If the homepage is ranking good for a "keyword", will that improve ranking of other landing pages which are optimised for related "keywords" & Vice-versa?
Algorithm Updates | | vtmoz0 -
Http vs Https Related Rankings Drop?
I've noticed in a number of keyword ranking tools (Moz included) that our rankings have dropped substantially for a number of our top performing keywords precisely 7 days back. When you view the attached screenshot you'll see there was a drastic drop in the overall organic impressions as well as a drop in keyword rankings. I also noticed that all the keywords which have dropped in rank now show with the https version of our home page url. I've read up on this and it believe that this should not cause a drop in rankings but we have even added https as a domain in webmaster tools with no improvement. Quite simply, has Google de-indexed our http home page url which was previously tied to our higher rankings for our core keywords? How can we get this back without "disavowing" our https version of the site. We're not doing anything to game search results so I dont think we're being penalized, simply there is some sort technical glitch taking place between recognizing HTTP vs HTTPS versions of our site. Our home page is goo.gl/qVPRwf and an example keyword is "wedding ring sets his and hers" Can anyone recommend further debugging steps or have an understanding of what can be done at this point? Also, if it helps, I have studied the Help Center, read the FAQs and searched for similar questions with no success.wedding ring sets his and hers impressions%20-%20ranking%20drop.png?dl=0
Algorithm Updates | | punitshah0 -
Home Page not ranking?
Hey guys, I'm working on a relatively new client and have noticed that all the initial rankings that we have point towards a sub page rather than the home page. Only a branded search appears to bring up the home page which seems really strange. Any ideas? Home page; www.geraldmiller.com Sub page (ranking); www.geraldmiller.com/dwi-dui-defense
Algorithm Updates | | Webrevolve0 -
Could EMD (Exact Match Domain) have cause SERP drops?
Hi all, Another suggestion was given for our fall in SERPS. Recently Matt Cutts announced that EMDs would be hit by new algoritms. http://www.seroundtable.com/google-panda-20-15789.html Only our site with exacts matches... cours-telephone-anglais, curso-ingles-telefono, kurse-englisch-telefon, and corso-inglese-telefono were hit. Does anyone else have experience of this? Would a solution be to create new URLS and redirect? Or would a redirect carry the penalty over? Is there anyway to fix that sort of penalty? Many thanks for your help.
Algorithm Updates | | Quime0 -
6 year old Corporate domain lost all rankings on EMD day.
Hello, our company's website goo.gl/7Q56G lost all our rankings after the EMD algo update. Our domain is NOT a EMD. At the same time, I found that we have about 6000 new, extremely low quality spam backlinks with the same anchor text ("loan"). I saw some of those a few weeks ago, but didn't really pay much attention because I didn't believe Google would think we build those. I didn't get any messages on webmaster central. If this occurred with the EMD update, is it because of the low quality backlinks? Most of the real spammers, brokers (we are the actual funding source) are now dominating the top 10 for our main keyword "merchant cash advance". We were in the top 10 for the past 4 years, why would we get hit so hard now? I really appreciate your advice.
Algorithm Updates | | DaveMri1