Screaming frog, Xenu, Moz giving wrong results
-
Hello guys and gals,
This is a very odd one, I've a client's website and most of the crawlers I'm using are giving me weird/ wrong results.
For now lets focus on screaming frog, when I crawl the site it will list e.g. meta titles as missing (not all of them though), however going into the site the title is not missing, and Google seems to be indexing the site fine. The robots.txt are not affecting the site (I've also tried changing the user agent).
The other odd thing is SF gives a 200 code but as a status tells me "connection refused" even though it's giving me data.
I'm unable to share the clients site, has any one else seen this very odd issue? And solutions for it?
Many thanks in advanced for any help,
-
Thanks Dan!
-
^ That's customer service!
-
Cheers for the tweet Andy.
Chris, I'd recommend running through this list here in our FAQ -
http://www.screamingfrog.co.uk/seo-spider/faq/#17
In particular, I'd recommend reducing the crawl speed & adjusting the user-agent.
You can also pop it through to our support (http://www.screamingfrog.co.uk/seo-spider/support/) & we can advise. All confidential etc.
Cheers
Dan
-
I have shared this question with Dan from Screaming Frog for you
-Andy
-
Hi Chris
This is hard to answer without an example - do you have a URL or two that you can share with the community?
Thanks so much!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to quit moz 30days free?
dear moz: my english is so poor!!haha!! my user id si heroiamhero,my email is heroiamhero@gmail.com. 2weeks ago i made a free on moz.com but i found it is not very useful for me ,so i want to quit free use ,please tell me how to quit moz 30days free,thankyou very much.
Moz Pro | | heroiamhero1 -
MOZ Pro - Page Grader Queries
Greetings! I started a new position last week and the extremely supportive director promised to give me anything I required to make my job easier. Of course, my first port of call was MOZ Pro. Having never used MOZ Pro before, I've just been getting to grips with it, fixing any pressing issues and giving the whole site a general SEO health check. A few fairly major issues have been flagged, which I'm in the process of fixing, and I'm currently putting our main landing pages through the MOZ Page Grader. After a little bit of tinkering, our iPhone 6 cases page has been graded B for the term 'iPhone 6 cases', but I have a few queries/concerns regarding some of the suggested fixes: **Avoid keyword stuffing in document **- The term 'iphone 6 cases' only appears thrice in the body, so it can't be that? The term, however, appears 23 times in the page's img alt tags. Could this be the issue? This is an ecommerce site that sells iPhone 6 cases, so the img alt tags are bound to contain that keyword. Each img alt tag is unique, so I don't really know what I can do here? "Show details for YouSave iPhone 6 0.6mm Clear Gel Case" is the example of the img alt tag of one of the products on that page, surely I can't remove the words 'iPhone 6 case'? Avoid too many internal links - MOZ suggests keeping the internal links to below 100 or, at a minimum, less than 100 links on the main navigation menu. I haven't counted, but I'd guess that page has more than 100 links, but not too many on the navigation menu. To me, this looks like a standard ecommerce page, with links to products and different pages via the top and bottom menus. Would I improve visibility if I reduced the amount of links by, say, reducing the number of products on the page? We currently have it set to 36, but can easily be reduced. Only One Canonical URL - We've put a fix in place for this issue and are just waiting for it to go live. For some reason rel=canonical tags have been duplicated on the majority of the pages. Like I say, this is being remedied, but I just wondered whether a duplicate tag negatively affect the page's visibility? The tags are identical and just point to the page they're on. I think that's about it for now! Thanks in advance and keep up the good work! Cheers, Lewis (Andrew is the name of the director) UPDATE Now I've sorted the rel=canonical issue, the pages are being graded A but still with the first two suggestions above.
Moz Pro | | PeaSoupDigital0 -
Why is the login button on moz.com timing out for too many resirects on safari?
On safari, when I click on "login" from moz.com, I quickly get a message saying safari can't open the page because of too many redirects. Firefox works fine. What gives?
Moz Pro | | Multiverse-Media-Group0 -
Not provided traffic in Moz
Hello, I was wondering, if anyone knew how moz handles non provided keywords? is it not displayed, or is it labeled as something else? I know in WMT, it still displays it. Thanks for your help.
Moz Pro | | PeterRota1 -
Annotations in Moz tools?
Beginner question, I know, but is there a way to add an annotation or event to the Moz tools, as I can in Google Analytics? I'd like to mark when a change was made. Thanks.
Moz Pro | | KelloggMoz0 -
Is there any report / tool that gives me last cache date for each page on my site ?
my site has several hundred pages, and it is important for me to know last crawl date of each page as well as number of pages cralwed in a particualr period ( from / to date ). is there any report in seomoz that can help for this ? or any other suggestion ?
Moz Pro | | elegantmicroweb0 -
Moz's customer service. Is this normal?
A few days ago I noticed an issue with the on-page optimizer, when I couldn't find a solution, or even any mention of the problem in the forum I posted a ticket at the help desk.
Moz Pro | | Abidos
After ten hours I got a generic reply that didn't answer my ticket so I posted saying so.
After two days of not getting any reaction I looked through the forums again, this time searching for reactions about Moz's help desk. I found the post saying that sometimes the mail with a reply isn't received correctly so I went to the page of the ticket.
Here I saw that not only didn't I get an answer but my issue had been marked as solved, even though my last message clearly stated that it wasn't. This was three days ago. So my question is, is this how Moz usually treats it's clients? I'm new and my free trial is about to expire. At this point Moz should be impressing me with their great tools and services, convincing me it's worth my money. If I can barely get their attention now I don't expect it to change once I have payed them.0 -
Why is the Rankings Report of SeoMoz always show inaccurate results?
I have been using SEOmoz PRO tool from last two months but I am not happy with the SEOmoz PRO Ranking Report.The results are very inaccurate and I am not able to understand why there is such a difference in the ranking results when SEOmoz tracks and when I track?Please reply at the earliest. Regards, Prashakth Kamath
Moz Pro | | 1prashakth0