How effective is Crawl DIagnostics in determining crawlibility?
-
Is Seomoz crawl diagnostics useful for determining what pages Google has a hard time indexing. One of the problems with my site is that it uses JS and Flash and I know Google isnt too keen on that. Can Crawl Diagnostics accurately tell me if there is too much of something and therefore Google is having a hard time crawling?
I want to be able to know if JS or Flash is hurting any of my pages in any way. I provide good content and I want to make sure Google can pick it up.....Is this too much to ask? Is there anything out there for this?
-
Hi Kyu,
Unfortunately, our crawler does not report if there are issues crawling your site due to JS or Flash, as it is actually unable to parse either of those languages so it does not process any information in those languages. Google's crawler is much more sophisticated than ours, as Host1 points out, so they may be able to parse your site and index it more thoroughly than we can.
Please let me know if you have any other questions.
-Chiaryn
-
Hi Kyu,
Host1 is correct about Google. You most likely don't need to worry about your Google index.
As for our crawler. Roger doesn't like Java or Flash so you may see your index and crawl diagnostic with us be hindered a bit as such.
Thanks!
Joel. -
http://support.google.com/webmasters/bin/answer.py?hl=en&answer=72746#1
I quote:
Googlebot can index almost any text a user can see as they interact with any Flash SWF file on your site, and can use that text to generate a snippet or match query terms in Google searches. Additionally, Googlebot can also discover URLs in SWF files (for example, links to other pages on your site) and follow those links.
We'll crawl and index this content in the same way that we crawl and index other content on your site—you don't need to take any special action. However, we don't guarantee that we'll crawl or index all the content, Flash or otherwise.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I got an 803 error yesterday on the Moz crawl for most of my pages. The page loads normally in the browser. We are hosted on shopify
I got an 803 error yesterday on the Moz crawl for most of my pages. The page loads normally in the browser. We are hosted on shopify, the url is www.solester.com please help us out
Moz Pro | | vasishta0 -
SEO for e-commerce, linking, brand mentions, insights diagnostics
Hi, I run the seo for www.bilthamber.com It is an e-commerce site selling car care products, and we also manufacture our own products. I was wondering how the seo for an e-commerce site might compare to the seo for a blog or information based site, or other types of site. And also how the seo for a particular product page on my site might compare to a information based page on my site. Are the tactics the same? Should you try and rank for similar terms, the same generic terms, or complelty unique terms for the best seo? Or should every page try and rank for different terms, to ensure that the engines dont rank 2 or more different pages for the same search term? And how many keywords or search terms should I try and rank a particular product page for? Or an information page, or blog page? Is there a minimum or maximum that is recommomended? Does the more terms you try and rank for on a page take the weight out of each of them? So having 4 really good search terms might be better than having 10 ok generic ones? How do I find out what are my best, most highly converting, most profitable keywords overtime for Google? I can find some information like this, but it is showing the stats for Bing UK, not Google, even though Google UK is my main engine in Moz. My domain authority has decreased by 3 this week, this is the first time it has gone down since I started with Moz a few months back, can anyone explain why? And how this will affect the rankings ect, and how I can get it back up higher agian? And for linking and brand mentions, what are the goals of this feature? Should I find my mentions and ask them to talk about us more and link to us properly? I'm not sure if this is right. Should I be asking other websites to make links to our pages, or should it be organic? And for the insights section, I am recieveing tons of issues a lot to do with duplicate content, will having the rel=carnocial tag fix these issues? I know thats a lot for 1 question, but its been building up in my head! Thanks in advance! Max
Moz Pro | | BiltHamber10 -
How to create effective Backlinks and promote very small sites?
I want to create effective backlinks and promote websites with having only 8-15 pages with very poor/basic content. Where client is unable to provide content, increase number of pages etc. So kindly suggest..
Moz Pro | | 1akal0 -
Will moz crawl pages blocked by robots.txt and nofollow links?
i have over 2,000 temporary redirects in my campaign report redirects are mostly events like being redirected to a login page before showing the actual data im thinking of adding nofollow on the link so moz wont crawl the redirection to reduce the notification will this solve my problem?
Moz Pro | | WizardOfMoz0 -
Only One page crawled..Need help
I have run a website in Seomoz which have many URLs with it. But when I saw the seomoz report that showing Pages Crawled: 1. Why this is happen my campaign limit is OK Tell me what to do for all page crawling in seomoz report. wV6fMWx
Moz Pro | | lucidsoftech0 -
Slowing down SEOmoz Crawl Rate
Is there a way to slow down SEOmoz crawl rate? My site is pretty huge and I'm getting 10k pages crawled every week, which is great. However I sometimes get multiple page requests in one second which slows down my site a bit. If this feature exists I couldn't find it, if it doesn't, it's a great idea to have, in a similar way to how Googlebot do it. Thanks.
Moz Pro | | corwin0 -
Crawl Report Technical Issue
I'm having a problem with our campaign especially the crawl report. Because the last update is Nov 4 and isn't supposed to be updated weekly? I already submit a helpdesk support ticket and even send a seperate e-mail regarding this issue but until now the report is still not updated. Anybody here can help me raise this issue/ Thanks.
Moz Pro | | shebinhassan0 -
Does it really take 3-7 days to crawl a site?
This is what you say on your website: Please note: depending on the size and speed of your site, it may take between 3 and 7 days to complete your crawl. Are you guys kidding? This is unacceptable for almost all of my deadlines, and I suspect 99% of the SEO world... you can fly to the moon faster.
Moz Pro | | rldonnell0