4xx error - but no broken links founded by Xenu
-
In my SeoMoz crawl report I get multiple 4XX errors reported and they are all on the same type of links. www.zylom.com/nl/help/contact/9/ and differiate between the number at the end and the language.
But I i look in the source code we nice said:
<a class="<a class="attribute-value">bigbuttonblue</a>" style="<a class="attribute-value">float:right; margin-left:10px;</a>" href="[/nl/help/contact/9/?sid=9&e=login](view-source:http://www.zylom.com/nl/help/contact/9/?sid=9&e=login)" onfocus="<a class="attribute-value">blur()</a>" title="<a class="attribute-value">contact</a>"> contact a>
I already tested the little helpfull tool Xenu, but this also doesn't give any broken links for the url's which I found in the 4xx error report.
Could somebody give me a suggestion Why these 4xx errors keep coming? Could it be that the SeoMoz crawlers break the part ?sid=9&e=login' from the URL. Because if you want to enter the link, you first get a pop-up to fill in a login screen.
Thanks for you answers already
-
Hey Letty
If I request the full link in webbug I get a 200 okay response.
http://www.zylom.com/nl/help/contact/9/?sid=9&e=login
If I request the link less the variables in webbug I get the 404 as reported by the moz crawler.
http://www.zylom.com/nl/help/contact/9/
I would go into analytics, check to see which pages you have 404's for if it is just '/nl/help/contact/9/' then I don't think you have a problem.
I think nofollow would be a good solution and if we look at part of the nofollow page on google webmaster support:
"Before
nofollow
was used on individual links, preventing robots from following individual links on a page required a great deal of effort (for example, redirecting the link to a URL blocked in robots.txt). That's why thenofollow
attribute value of therel
attribute was created. This gives webmasters more granular control: instead of telling search engines and bots not to follow any links on the page, it lets you easily instruct robots not to crawl a specific link. For example:"Now, I am not 100% sure if the seomoz crawler respects nofollows (I would imagine it does) but certainly, if other robots are following this link and generating 404's (again, head into your analytics to get a handle on this) then it will certainly help there.
After all, this link is not for robots, it is not to be indexed, it is just a log in form for users so nofollowing that link seems to make perfect sense.
Hope that helps!
MarcusReferences:
http://support.google.com/webmasters/bin/answer.py?hl=en&answer=96569
-
Hi Marcus,
A link would be www.zylom.com/nl/help/contact/9/?sid=9&e=login
I think the pop-up screens which requested an login, is causing the 4xx error. because you can't enter without login. Think we should put a no-follow on these types of url's and that could solve the problem. What are your thoughts after seeing the link.
-
Hey Letty
It is somewhat hard to say without seeing a link but if Xenu says no broken links then it is likely as you suspect and the moz crawler is having a problem with those links.
Maybe try to confirm one way or the other in Google Analytics. An easy way (from memory) to do this is to search your pages so Content > Site Content > All pages for your custom 404 page (if you have one). Then, you can dig in and see if these are real errors or are just some kind of red herring (most likely).
Hope that helps!
Marcus
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Critical crawler errors...4xx
Hey fam, I ran the Critical Crawler Issues and found 9 pages with critical crawler issues. I'm running a wordpress site and looked in the dashboard for Pages and Posts but the links aren't in the dashboard. Can you help fix? Thank you!
Technical SEO | | Myflgreen0 -
Internal Link Rank Flow
I've read in many articles that pages can "pass" rank to other pages internally. Is anyone aware of any well done internal linking case studies which confirm this? If my homepage has the strongest Page Authority, would linking to another page deeper into my website from my homepage boost my rank for the deeper page in Google (more so than linking to the deep page from a page with lower page authority)?
Technical SEO | | poke10 -
Wordpress 4xx errors from comment re-direct
About a month ago, we had a massive jump in 4XX errors. It seems the majority are being caused by the comment tool on wordpress, which is generating a link that looks like this "http://www.turnerpr.com/blog/wp-login.php?redirect_to=http%3A%2F%2Fwww.turnerpr.com%2Fblog%2F2013%2F09%2Fturners-crew-royal-treatment-well-sort-of%2Fphoto-2-2%2F" On every single post. We're using Akismet and haven't had issues in the past....and I can't figure out the fix. I've tried turning it off and back on; I'm reluctant to completely switch commenting systems because we'd lose so much history. Anyone seen this particular re-direct love happen before? Angela
Technical SEO | | TurnerPR0 -
Webmaster internal links issue
Hi All, In webmaster > Internal links https://www.google.com/webmasters/tools/internal-links?hl=en&siteUrl= I get counts as in the image http://imgur.com/9bO5H0f is this logical and ok or should i work on finding why so many links and reduce them? Thanks Martin
Technical SEO | | mtthompsons0 -
Internal Link Analysis Tool
I want to get a better handle on what internal link text (and co-occurance if possible) my site currently has. We have a lot of old blog articles that provide link juice back to the main site, but with thousands of pages, we never kept track of when we internally link to a page. Are there any tools that will provide an analysis of this? OpenSiteExplorer seems like a very tedious way to do it and it didn't appear to be 100% accurate. Also, are there any tools that will provide analysis and recommendations based on keywords targeted?
Technical SEO | | TheDude0 -
404 Errors After Site Migration
Hello - I'm working on a website selling fashion accessories. The site just went through a site migration from Yahoo! to Big Commerce. Now we have a high level of warnings and errors from the crawl. Few are mentioning sites I never seen before on the Yahoo! platform. I also notice that the pages crawled has doubled. How can I fix or did I do something wrong with migration? I was running the website with minimal errors and now overwhelmed with errors all the error updates. If I can get some assistance on what could be wrong, I would greatly appreciate. Thanks.
Technical SEO | | ShopChameleon0 -
Rel=nofollow for affiliate links?
Hi, For a holiday/travel website including hotels and holiday packages from affiliates I am currently using the rel="nofollow" attribute to link out to the affiliate's website and wanted to know if this is the right way? To be more precise: there are distinct pages for each city and on a city specific page there are ~50 available hotels listed with some other information such as price and address, etc. Each of these hotels have an outlink to the affiliate's hotel website which uses private branding and as such is running on a subdomain hotels.mytraveldomain.tld. So in order not to pass on the link juice to the affiliate's website I thought I would simply use rel="nofollow". Would you also use nofollow? or are there any other opinions out there about that?
Technical SEO | | socialtowards1 -
External link optimization
The company I work for sells software online. We have deals learning institutes that allow their students to use our software for next to nothing. These learning institutes, which are usually quite strong domains, link to our sign in area. Nice way to get powerful links hey… or is it? There are a couple of problems with these links: They all link to a subdomain (signin.domain.com) The URLs also contain unique identifiers (so that we know which institute they are coming from). Meaning they all link to different signin URLs. (eg. signin.domain.com/qwerty, signin.domain.com/qwerta, signin.domain.com/qwerts, etc. ) So all these links aren't as effective as they could be (or at all?). In a perfect SEO world these links would all point to the start page, however, due to the fact that our start page is of a commercial set up this would run the risk of communicating the wrong idea to the institutes and their students. So… are there any extremely brilliant pro mozzers that have a savvy idea how set this up in a more SEO friendly way? Thanks in advance!
Technical SEO | | henners0