SEOMOZ Crawler unicode bug
-
for the last couple of weeks the SEOMOZ crawls my homepage only and gets 4xx error for most of the URL's.
the crawler have no issues with English url's only with the unicode(Hebrew) ones.
this is what is see in the csv export for the crawl (one sample) :
http://www.funstuff.co.il/׳ž׳¡׳׳‘׳×-׳¨׳•׳•׳§׳•׳× 404 text/html; charset=utf-8
you can see that the URL is Gibberish
please help.
-
Hey Asaf,
Thanks for writing in.
We have a known issue where Hebrew isn't parsed right by our crawler so it has caused issues in the past. The issues have been intermittent but they can affect the data you see. Sorry about that. Our engineers have been working to get a fix out there for the Hebrew character set, so stay tuned.
Best,
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEOMoz Question
Hi, I have taken over SEO on a real estate site with an internal blog. Unfortunately there are loads of duplicated pages and titles in the blog. It was suggested that all should be rel=canonical so not to show up. In my last crawl here though they still do. So question is if SEOMoz crawls and sees them is Google also seeing them? Also would it be best to move the blog off site so this does not cause anymore damage and just link to it from the main site? Thanks for your comments
Moz Pro | | AkilarOffice0 -
Keyword rankings are not updating from past two weeks? Is there any issue in SEOmoz tool ?
I have added 215 keywords to my account. From past two weeks i am waiting to see the rankings, however it's not updating.
Moz Pro | | Sasank0 -
Seomoz crawling filtered pages
Hi, I just checked an seo campaign we started last week, so I opened seomoz to see the crawl diagnostics. Lot's of duplicate content & duplicate titles showing up, but that's because Rogerbot is crawling all of the filtered pages as well. How do I exclude these pages from being crawled? /product/brand-x/3969?order=brand&sortorder=ASC
Moz Pro | | nvs.nim
/product/brand-x/3969?order=popular&sortorder=ASC
/product/brand-x/3969?order=popular&sortorder=DESC&page=10
/product/brand-x/3969?order=popular&sortorder=DESC&page=110 -
Seomoz & Duplicate Page Content Issue?
Hi, What is the criteria on Seomoz Crawl Diagnostic Report? I got a long list of URLs indicating Content that is identical (or nearly identical) to content on other pages of your site forces your pages to unnecessarily compete with each other for rankings. But as I gone through none of the reported pages duplicate. What should I do? Thanks in Advance
Moz Pro | | VipinLouka780 -
SEOmoz LDA tool experience?
http://www.seomoz.org/labs/lda Does anyone presently use this tool as a regular part of their SEO analysis? Does anyone have any updates regarding this tool? It is still in the lab despite no updates for over 6 months. Is it being retired? Or promoted to production? If you do use the tool, what % of relevance is your goal when optimizing pages?
Moz Pro | | RyanKent0 -
SEOmoz mobile search keyword tracking?
Does anyone know if we can expect keyword rank tracking in Google mobile? It would be a cool feature for SEOmoz Pro. Does anybody know of any reliable software that does this at the moment?
Moz Pro | | A_Q0 -
Would an SEOmoz Q & A feed be useful?
I don't see a Q & A feed subscribe button. Am I missing it? Seems to me that being able to receive updates when new questions are posted would be useful.
Moz Pro | | Gyi1