Crawl Test Tool - SEO Web Crawler work on mobile sites?
-
Hi does the MOZ Crawl Test Tool - SEO Web Crawler work on mobile sites?
-
Thanks Abe! I should be good now.
-
Hello! Yes, our crawl test tool does work with most mobile sites. I confirmed this earlier this morning as well for a member I'm working with at the moment. If you are having trouble with the tool, feel free to contact help@Moz.com with exact page examples.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Search volume discrepancies between keyword tools
I'm feeling like I'm basing all my research time on tools that I cannot necessarily trust. Between Google keyword planner, Keywords everywhere chrome extension, and Moz keyword explorer, I'm getting wildly different results on 2 simple keywords related to colleges with baking & pastry arts degrees. "baking college", "baking colleges" So Keyword planner won't give me any search volume for those 2 words, I don't even see them in the results. Instead, it decides I really meant "baker college" which has 33,100 global searches. I tried telling it use only closely related terms, but it keeps giving me "baker college" and refuses to show me the terms I asked for. Stubbornly useless. Keywords everywhere says both of these keywords bring in 33,100 searches. It does not tell me those searches were for "baker college." Totally misleading. Moz keyword explorer says baking college as 0-10 volume, baking colleges has 101-200 volume. So at least it's not trying to give me "baker college" numbers. Perhaps I can trust this, but it's not convenient to upload hundreds of various keywords at a time to pull the volume numbers like I do with the other tools. With Keyword planner making assumptions and grouping unrelated terms together, and Keywords everywhere using those numbers without pointing out the assumptions, I feel like I can't trust anything without taking time to dig into the discrepancies, which is impossible with hundreds of keywords. Do you know of any good search volume tools that don't force or hide assumptions? Thanks.
Moz Bar | | JannetteP1 -
How do I disallow crawl on a directory when it's a prefix to my site's URL?
I am trying to disallow our media repository (hosted elsewhere, but appears as a directory on our site) from being crawled by robots but it is not a subdirectory of the site, it's a prefix. So I need to disallow: mediabank.mywebsite.org Not: mysite.org/mediabank What would I need to put in my robots.txt and/or the other host's robots.txt to make this happen? Thanks!
Moz Bar | | Simon-Plan0 -
Error 406 with crawler test
hi to all. I have a big problem with the crawler of moz on this website: www.edilflagiello.it. On july with the old version i have no problem and the crawler give me a csv report with all the url but after we changed the new magento theme and restyled the old version, each time i use the crawler, i receive a csv file with this error: "error 406" Can you help me to understan wich is the problem? I already have disabled .htacces and robots.txt but nothing. Website is working well, i have used also screaming frog as well.
Moz Bar | | ArchieDonnithorne0 -
MOZ crawler has been finding a lot of 803 and 804 errors
During last 3 weeks MOZ crawler has been finding a lot of 803 and 804 errors. Meanwhile all pages seem to be working fine. What could cause it?
Moz Bar | | Paruyr0 -
On the Keyword Difficulty tool what do the green boxes and ticks mean?
Hi, I'm trying to figure out what the significance of the colors are in the Keyword Difficulty tool. When I do a search some of the boxes are light green, some dark green and some of them have ticks - any ideas? Thanks, Matt
Moz Bar | | MattNW0 -
Crawl Diagnostics - nofollow - reducing duplicate pages
Hi I'm looking at a crawl diagnostic report, I can see I have many duplicate pages, the reason for this is that when a brand filter is applied to a page. IE
Moz Bar | | chameleondm
www.mysite.com/mycategory - lets say this is the product listing page
www.mysite.com/category/mybrand - and this is the same page but with a brand filter applied
www.mysite.com/category/myotherbrand - and this is the same page but with a different brand filter applied I had intially appendeded the meta title, description and keywords with some extra content if a brand filter was applied, because the page on the whole does have different content. IE I would have a custom meta information, H1 tag and products on that page just for that specific brand.
However I am wondering if these two pages are really just competing with each other as lots of the content will be the same. Should I scrap that approach and use either nofollow on the brand filter link, or simply use a canonical. Thanks, James1 -
Not getting foreign characters in crawl diagnostics .csv
The crawl diagnostics .csv file is showing high-ascii characters instead of the correct language (foreign language website) e.g. Vietnamese, Chinese (both kinds), etc. Is there a way to get this right?
Moz Bar | | trainSEM0