Google not crawling the website from 22nd October
-
Hi, This is Suresh. I made changes to my website and I see that google is unable to crawl my website from 22nd October. Even it is not showing any content when I use Cache:www.vonexpy.com. Can any body help me in knowing why Google is unable to crawl my website. Is there any technical issue with the website? Website is www.vonexpy.com
Thanks in advance.
-
Looks like its not just us - this is starting to get more attention https://www.seroundtable.com/google-cache-dated-19497.html
-
Our home page was cached today, but many of the pages on our site haven't been indexed since late October. It looks like this is a widespread issue.
-
I can see 90% of the pages I look at havent been cached since 22nd Oct, and I mean pages picked at random from hotels.com, booking.com and other big sites - is there a wider google cache issue going on?
-
I understand but we are not talking about black hat seo, just to crawl a site that hasn´t be crawled since october. And we all already know that sometimes Google says half-truths. I was suggesting to do something knew to get different results that he already had. Anyway i appreciate your point of view.
-
Google the queries: black hat seo, link buying. Click the first 100 results for both + read the guide on SEO by Google and then you probably get the point ;-).
-
Why not Martijn? That tool has helped me several times not in the same case but for backlinks.
-
You are not being serious?
-
Thanks Martin,
I made some design changes to my website. When you check the cache you an see that the website content is not crawled as the website contains some java script links. I replaced them with text links. So now it should crawl and index the website even though there is no new content. As the old spider is unable to crawl the website because of the image based links. And also I submitted the sitemap to webmaster tools only after the design change. It just indexed all the 30 urls 2 days back.@ Hemani I already submitted to webmaster tools and used fetch as google on the site but still there is no crawling.
-
Hi Suresh,
It looks like there are no problems on the site itself that prevent Google from crawling it, so that's a good thing. As the sitemap only consists of 31 (different) URLs, chances are that Google found out that the pages aren't any different any time that they crawled the pages. If that is really the case then I wouldn't mind so much about Google not crawling the content every now and then.
-
This is a normal problem and I have accord this quite a few times on my blog. The best way to do that is to submit your sitemap in Google Webmaster tool and get social tweets and social likes on your website and you will see Google will start crawling your website in days!
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What is a good crawl budget?
Hi Community! I am in the process of updating sitemaps and am trying to obtain a standard for what is considered "strong" crawl budget? Every documentation I've found includes how to make it better or what to watch out for. However, I'm looking for an amount to obtain for (ex: 60% of the sitemap has been crawled, 100%, etc.)
Technical SEO | | yaelslater1 -
Google crawling but not indexing for no apparent reason
Client's site went secure about two months ago and chose root domain as rel canonical (so site redirects to https://rootdomain.com (no "www"). Client is seeing the site recognized and indexed by Google about every 3-5 days and then not indexed until they request a "Fetch". They've been going through this annoying process for about 3 weeks now. Not sure if it's a server issue or a domain issue. They've done work to enhance .htaccess (i.e., the redirects) and robots.txt. If you've encountered this issue and have a recommendation or have a tech site or person resource to recommend, please let me know. Google search engine results are respectable. One option would be to do nothing but then would SERPs start to fall without requesting a new Fetch? Thanks in advance, Alan
Technical SEO | | alankoen1230 -
SEO for Parallax Website
Hi, Are there any implications of having a parallax website and the URL not changing as you scroll down the page? So basically the whole site is under the same URL? However, when you click on the menu the URL does change? Cheers
Technical SEO | | National-Homebuyers0 -
How to inform Google to remove 404 Pages of my website?
Hi, I want to remove more than 6,000 pages of my website because of bad keywords, I am going to drop all these pages and making them ‘404’ I want to know how can I inform google that these pages does not exists so please don’t send me traffic from those bad keywords? Also want to know can I use disavow tool of google website to exclude these 6,000 pages of my own website?
Technical SEO | | renukishor4 -
Local Google vs. default Google search
Hello Moz community, I have a question: what is the difference between a local version of Google vs. the default Google in regards to search results? I have a Mexican site that I'm trying to rank in www.google.com.mx, but my rankings are actually better if I check my keywords on www.google.com The domain is a .mx site, so wouldn't it make more sense that this page would rank higher on google.com.mx instead of the default Google site, which in theory would mean a "broader" scope? Also, what determines whether a user gets automatically directed to a local Google version vs. staying on the default one? Thanks for your valuable input!
Technical SEO | | EduardoRuiz0 -
Does Google index has expiration?
Hi, I have this in mind and I think you can help me. Suppose that I have a pagin something like this: www.mysite.com/politics where I have a list of the current month news. Great, everytime the bot check this url, index the links that are there. What happens next month, all that link are not visible anymore by the user unless he search in a search box or google. Does google keep those links? The current month google check that those links are there, but next month are not, but they are alive. So, my question is, Does google keep this links for ever if they are alive but nowhere in the site (the bot not find them anymore but they work)? Thanks
Technical SEO | | informatica8100 -
Tags showing up in Google
Yesterday a user pointed out to me that Tags were being indexed in Google search results and that was not a good idea. I went into my Yoast settings and checked the "nofollow, index" in my Taxanomies, but when checking the source code for no follow, I found nothing. So instead, I went into the robot.txt and disallowed /tag/ Is that ok? or is that a bad idea? The site is The Tech Block for anyone interested in looking.
Technical SEO | | ttb0 -
Is google all over the place tonight?
Is it me or is google all over the place tonight? Whilst checking my rankings I came across a site with a page authority of 29 and 23 links from 5 domains ranking at number 6 for a competitive keyword! This site came from nowhere and I'm getting different results every time I search! Weird....
Technical SEO | | SamCUK0