Google not crawling the website from 22nd October
-
Hi, This is Suresh. I made changes to my website and I see that google is unable to crawl my website from 22nd October. Even it is not showing any content when I use Cache:www.vonexpy.com. Can any body help me in knowing why Google is unable to crawl my website. Is there any technical issue with the website? Website is www.vonexpy.com
Thanks in advance.
-
Looks like its not just us - this is starting to get more attention https://www.seroundtable.com/google-cache-dated-19497.html
-
Our home page was cached today, but many of the pages on our site haven't been indexed since late October. It looks like this is a widespread issue.
-
I can see 90% of the pages I look at havent been cached since 22nd Oct, and I mean pages picked at random from hotels.com, booking.com and other big sites - is there a wider google cache issue going on?
-
I understand but we are not talking about black hat seo, just to crawl a site that hasn´t be crawled since october. And we all already know that sometimes Google says half-truths. I was suggesting to do something knew to get different results that he already had. Anyway i appreciate your point of view.
-
Google the queries: black hat seo, link buying. Click the first 100 results for both + read the guide on SEO by Google and then you probably get the point ;-).
-
Why not Martijn? That tool has helped me several times not in the same case but for backlinks.
-
You are not being serious?
-
Thanks Martin,
I made some design changes to my website. When you check the cache you an see that the website content is not crawled as the website contains some java script links. I replaced them with text links. So now it should crawl and index the website even though there is no new content. As the old spider is unable to crawl the website because of the image based links. And also I submitted the sitemap to webmaster tools only after the design change. It just indexed all the 30 urls 2 days back.@ Hemani I already submitted to webmaster tools and used fetch as google on the site but still there is no crawling.
-
Hi Suresh,
It looks like there are no problems on the site itself that prevent Google from crawling it, so that's a good thing. As the sitemap only consists of 31 (different) URLs, chances are that Google found out that the pages aren't any different any time that they crawled the pages. If that is really the case then I wouldn't mind so much about Google not crawling the content every now and then.
-
This is a normal problem and I have accord this quite a few times on my blog. The best way to do that is to submit your sitemap in Google Webmaster tool and get social tweets and social likes on your website and you will see Google will start crawling your website in days!
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Amp version of website
Hello & thanks for reading its maybe the monday morning blues but i have two versions of a website - www.gardeners.scot and www.gardeners.scot/AMP/ the pages on the amp version have canonicals pointing to the "normal" website Should the links on "www.example.com/AMP/" point to the amp website or the normal website? what are your thougths?
Technical SEO | | livingphilosophy0 -
Could using our homepage Google +1's site wide harm our website?
Hello Moz! We currently have the number of Google +1's for our homepage displaying on all pages of our website. Could this be viewed as black hat/manipulative by Google, and result in harming our website? Thanks in advance!
Technical SEO | | TheDude0 -
Mobile website question
Hi Mozzers, A website I manage has a mobile friendly version of their main website and a /m version as well. I was wondering if anyone had any experience in the best way of handling this? Should we just get rid of the /m version and tag the mobile friendly version? Thanks!
Technical SEO | | KarlBantleman0 -
Hit by Google
My site - www.northernlightsiceland.com - has been hit by google and Im not sure why. The traffic dropped 75% last 24 hours and all the most important keywords have dropped significantly in the SERP. The only issue I can think of are the subpages for the northern lights forecasting I did every day e.g. http://www.northernlightsiceland.com/northern-lights-forecast-iceland-3-oct-2012/ I have been simply doing a copy/paste for 1 month the same subpage, but only changing the top part (Summary) for each day. Could this be the reason why Im penalized? I have now simply taken them all down minus the last 3 days (that are relevant). What can I do to get up on my feet again? This is mission critical for me as you can imagine. Im wondering if it got hit by this EMD update on 28 sept that was focusing on exact match domains http://www.webmasterworld.com/google/4501349-1-30.htm
Technical SEO | | rrrobertsson0 -
Website redesign launch
Hello everyone, I am in the process of having my consulting website redesigned and have a question about how this may impact SEO. I will be using the same URL as I did before, just simply replacing an old website with a new website. Obviously the URL structure will change slightly since I am changing navigation names. Page titles will also change. Do I need to do anything special to ensure that all of the pages from the old website are redirected to the new website? For example, should I do a page level redirect for each page that remains the same? So that the old "services" page is pointed to the new "services" page? Or can I simply do a redirect at the index page level? Thank you in advance for any advice! Best, Linda
Technical SEO | | LindaSchumacher0 -
How to remove crawl errors in google webmaster tools
In my webmaster tools account it says that I have almost 8000 crawl errors. Most of which are http 403 errors The urls are http://legendzelda.net/forums/index.php?app=members§ion=friends&module=profile&do=remove&member_id=224 http://legendzelda.net/forums/index.php?app=core&module=attach§ion=attach&attach_rel_module=post&attach_id=166 And similar urls. I recently blocked crawl access to my members folder to remove duplicate errors but not sure how i can block access to these kinds of urls since its not really a folder thing. Any idea on how to?
Technical SEO | | NoahGlaser780 -
Google crawl rate almost zero since re-launch, organic search up 50% though!
We're confused as to why Google's crawl of our site has dropped hugely since our new site went live. The URLs of almost all pages changed, and were 301d to the new site. About 20% of our pages were blocked by robots.txt for the re-launch. The re-launch has been great for organic search, with hits up about 50%. Yet our new content is taking a lot longer to get indexed than before. Our KB downloaded a day according to webmaster tools are well down, as is time spent downloading a page. Any ideas as to why this is?i7hwX.png
Technical SEO | | soulnafein0