Getting Recrawled by Google
-
I have been updating my site a lot and some of the updates are showing up in Google and some are not. Is there a best practice in getting your site fully recrawled by Google?
-
If your site does not get crawl completely, i will recommend
a) To create a site-map, so that search engines can understand the site hierarchy and can deep crawl the site
b) Look at your site structure, Make your site more organized so as to have better crawl. It should not happen that a user needs to visit - home page > category page > sub category page > article or below to read the article. At best, article snippet should come on home page for a day. If not, should be accessible from home page > category page > article
c) Submit the article posted to Social Media - Reddit, Pinterest, Twitter etc. It will help search engines discover your link faster
By sure - will improve the crawl mechanism to your site
-
PS
#1
http://www.distilled.net/blog/seo/beginners-guide-doing-a-site-audit-using-google-webmaster-tools/
http://www.google.com/submityourcontent/
https://support.google.com/webmasters/answer/1352276?hl=en
Same rules for Google https://seomoz.zendesk.com/entries/409821-Why-Isn-t-My-Site-Being-Crawled-You-re-Not-Crawling-All-My-Pages
-
Heres more
Kristina Kledzik from distilled wrights about this a lot
http://www.distilled.net/about/people/kristina-kledzik/
http://www.zemanta.com/blog/technical-seo-audit-for-publishers/
http://www.distilled.net/blog/seo/site-navigation-for-seo/
http://yoast.com/how-to-get-google-to-crawl-your-site-faster/
http://www.stateofsearch.com/a-guide-to-crawling-indexing-and-ranking-your-websit/
http://www.distilled.net/blog/seo/how-to-do-a-5-step-site-audit/
http://www.seerinteractive.com/blog/easy-ways-seo-can-kill-your-site
Use Screaming Frog SEO Spider Use this with http://www.seerinteractive.com/blog/screaming-frog-guide
http://www.portent.com/blog/seo/three-seo-deal-killers.htm
Other good to know
http://www.distilled.net/blog/seo/beginners-guide-doing-a-site-audit-using-google-webmaster-tools/
http://www.portent.com/blog/seo/5-seo-strategies-we-swear-arent-going-anywhere.htm
http://www.mnsearch.org/john-doherty-from-distilled-teaches-mnsearch-about-technical-seo/
Hope this help's,
Thomas
-
Hi,
Yes here is a link to some good info & tips
http://www.distilled.net/blog/seo/advanced-seo-troubleshooting-why-isnt-this-page-indexed/
Absolutely. Make sure you have a fast hosting company hosting your website.
Make sure there's no flash, Ajax, or JavaScript obscuring your site from Google bot
Make sure your robots.txt file is not no following or no indexing any thing that you want to be found by Google
Same goes for your tags
- noindex X-Robots-Tag in HTTP header (X-Robots-Tag: noindex)
- Incorrect mime type declared in HTTP header. For example, for an HTML document, if it was declared as Content-Type: text/javascript
You can use Google Webmaster tools and the selection fetches Google bot and submit all URLs to index if you want to make sure it is being indexed in Google knows that you want the site indexed.
I hope I've been out sincerely,
Thomas
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Favicon not showing in google serps
Hi, I have a website where the favicon is not showing in the google mobile serps. It's appearing the default icon instead (world icon). This is the tag I have place in the head section of the website: <link rel="shortcut icon" href="/favicon.ico" /> The size of the favicon is 48x48 and it's appearing correctly in the browser tag. I've checked that the google robot can crawl it and in the server logs I can see requests from the "Google Favicon" user-agent. Has anyone had this same problem? Any advice?
Technical SEO | | dMaLasp0 -
Website homepage temporarily getting removed from google index
hi, website: www.snackmagic.com The home page goes out of google index for some hours and then comes back. We are not sure why our home page is getting de-indexed temporarily. This doesn't happen with other pages on our website. This has been happening intermittently in the gap of 2-3 days. Any inputs will be very useful for us to debug this issue Thanks
Technical SEO | | manikbystadium0 -
When will all of Google Maps be the same again?
As many of you are aware that the pigeon update was only applied to the new Google maps resulting in very different search results for Google local business. When you search for a business on old Google maps then you get totally different results vs the new Google maps. Some businesses totally disappeared completely from the search results. I have done my research and found out that it's because the new Algo was only applied to the new maps. Also new algo does not apply to other countries. Well the reason I posted this topic is because I have noticed that all the new Google Business listings I am verifying for my clients are all being put under the old Google maps and not the new ones. They come up fine when searching from old maps but not the new ones. I understand Google has not rolled out the pigeon on all data centers but why? Will Google eventually roll out the update to old maps? Since Google is adding businesses to old google maps then what's the point of even adding new listings?
Technical SEO | | bajaseo0 -
I am trying to figure out why a website is not getting fully indexed by google. Any ideas?
I am trying to figure out why a website is not getting fully indexed by google. The website was built with Godaddy's website designer so maybe this is the problem. Originally, the internal links throughout the navigation were linked to “pages” within the site. I went in and changed all of these navigation links to point to the actual url links throughout the site instead of relative links pointing to pages on the server. I thought this would have solved the problem because I thought that perhaps google was not able to follow the original relative links. When I check to see how many pages are in the google index I still see the same #. What is going on? Should this website be rebuilt using more search engine friendly code like wordpress? Is there a simple fix that will enable google to find all of this content created by Godaddy design software? I appreciate any help offered. Here is the site- http://www.securehomeusa.com/
Technical SEO | | ULTRASEM0 -
I have custom 404 page and getting so much 404 error on Google webmaster, what should i do?
I have a custom 404 page with popular post and category links in the page, everyday i have 404 crawl error on webmaster tools, what should i do?
Technical SEO | | rimon56930 -
Pages not indexed by Google
We recently deleted all the nofollow values on our website. (2 weeks ago) The number of pages indexed by google is the same as before? Do you have explanations for this? website : www.probikeshop.fr
Technical SEO | | Probikeshop0 -
Google Analtyics Changes?
Did anyone else's google analtyics numbers jump up this month? Our unique visitors increased some, but our pageviews tripled and our bounces dropped significantly. We have been working to optimize the sites and did have a huge drop in errors in our campaign reports.
Technical SEO | | Stevej240 -
Google Plus 1
How google plus 1 votes can affect your position in google search engine? On my website i have a google plus button, i have just 3 votes, if i buy lets say 100 votes, but slowly, in a month, will this affect my ranking positively?
Technical SEO | | prunarevic0