Any idea why this is reporting a 404 in MozTools?
-
I did away with a vague category and 301 redirected the category url to the home page. However the link is reporting as a 404 in Moz Tools when it scans my site. Here's the link, and as you can see it redirects to the home page. Just curious if I did something wrong. Thanks.
-
Totally agree with Ryan, you should redirect https to http
Trivial maybe, but can see no reason not to do it as it takes no effort and makes your site even more accessible to users who mis-type, key your address directly into the url bar while on a https site etc
*This was in response to Ryans post which started "Perhaps i am being too picky..." I accidentally clicked the wrong reply button!!
-
Hi Rick,
While I know that Ryan decided to drop the https:// protocol problem, I just wanted to explain why it could be an issue for you.
It may not be a concern for a lot of personal sites, but for those where the site may be serving a strongly recognized brand it definitely should be a concern. That recognition could be coming both from your online visibility and/or from your involvement in offline communities or activities. Basically, if you have a reputation or following, people who know of your site will be much more likely to type your URL straight into a browser to go there.
I, for example, have come to know and love noahsdad.com through your involvement here in SEOmoz Q&A. I've visited the site, love your work and from time to time it crosses my mind to drop in and see what Noah has been up to lately. Since I know the site's domain, when that happens, I click inside the field at the top of my browser and replace everything after the www of the site that is open with noahsdad.com.
Now, in the event that the page I had open in my browser when I did that happened to be using the https:// protocol and I didn't realize that (which often happens), I would actually be asking my browser to go to https://www.noahsdad.com...and I think now you see why this could be an issue for you.
Hope that helps
Sha
Thumbs up for the catch too Ryan!
-
It could be that MozTools is looking at a cached version . You could try fetching it in Google Webmasters Tool to see how Google sees it ( which is what you should really worry about )
But as far as I can see you have 301 in place for that category to your home page : www.webconfs.com/http-header-check.php?submit=submit&url=http://noahsdad.com/mom-md
-
I would need to see the full record from the crawl report in order to respond. Perhaps you can upload the record to a web server and share the link?
-
No worries.
My real question is still why the redirect is showing up as a 404 when the site is crawled. I'd still be interested in figuring that out if you have any thoughts.
Thanks.
-
I am going to let this issue drop since it is such a small item for a personal site. A few last thoughts:
**Wordpress automatically redirects to the non http version. **
No, it does not. On the SEOmoz site, you are seeing the proper redirect. For example, if you take this Q&A post and prefix it with https:// you will wind up on this exact Q&A post in the http:// protocol. If you look at the Mozbar, you will see the redirect.
On your site, you are taken to another page from your hosting company.
**I dont know many personal sites that pay for a https cert **
There is no need for you to purchase a SSL certificate. That is not what I was suggesting.
I apologize for bringing this trivial matter up. Please disregard.
-
Ryan,
Thanks for your feedback. Wordpress automatically redirects to the non http version.
Regarding https sites I dont know many personal sites that pay for a https cert (or even why there would be a need.) Also I don't link to anything with https. It doesn't seem really seem necessary (unless I"m missing something.)
Heck, I just tried to go to https://seomoz.com and their site doesn't even go there.
-
Perhaps I am being too picky, especially for a non-business site.
I would share that even though your site is noahsdad.com, you took the effort to redirect www.noahsdad.com to noahsdad.com, right? Why did you take that extra step?
Whatever the response, the same concept would apply to the redirect from https protocol to http. The issue may never come up, but then again it only requires minimal effort to close this gap.
-
Yah, but my site is http://noahsdad.com/ - should I expect https to also work?
-
Try going to the following address: https://noahsdad.com
-
Yelp, the crawl just happened today.
Also you'll have to excuse my ignorance but I'm not sure what you mean by the last half of your comment. "my site does not handle https protocol well?"
Can you explain that to me. (I'm still learning.)
Thanks for taking the time to help by the way.
-
Are you certain you crawled the site after the redirect was in place?
If so, can you share the full record?
By the way, while looking at this is issue I noticed your site does not handle https protocol well. Try using it on your home page and see what happens. If your site does not use https, I would suggest redirecting all https requests to their http equivalent.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
520 Error from crawl report with Cloudflare
I am getting a lot of 520 Server Error in crawl reports. I see this is related to Cloudflare. We know 520 is Cloudflare so maybe the Moz team can change this from "unknown" to "Cloudflare 520". Perhaps the Moz team can update the "how to fix" section in the reporting, if they have some possible suggestions on how to avoid seeing these in the report of if there is a real issue that needs to be addressed. At this point I don't know. There must be a solution that Moz can provide like a setting in Cloudflare that will permit the Rogerbot if Cloudflare is blocking it because it does not like its behavior or something. It could be that Rogerbot is crawling my site on a bad day or at a time when we were deploying a massive site change. If I know when my site will be down can I pause Rogerbot? I found this https://developers.cloudflare.com/support/troubleshooting/general-troubleshooting/troubleshooting-crawl-errors/
Technical SEO | | awilliams_kingston0 -
'domain:example.com/' is this line with a '/' at the end of the domain valid in a disavow report file ?
Hi everyone Just out of curiosity, what would happen if in my disavow report I have this line : domain:example.com**/** instead of domain:example.com as recommended by google. I was just wondering if adding a / at the end of a domain would automatically render the line invalid and ignored by Google's disavow backlinks tool. Many thanks for your thoughts
Technical SEO | | LabeliumUSA0 -
WebMaster Tools keeps showing old 404 error but doesn't show a "Linked From" url. Why is that?
Hello Moz Community. I have a question about 404 crawl errors in WebmasterTools, a while ago we had an internal linking problem regarding some links formed in a wrong way (a loop was making links on the fly), this error was identified and fixed back then but before it was fixed google got to index lots of those malformed pages. Recently we see in our WebMaster account that some of this links still appearing as 404 but we currently don't have that issue or any internal link pointing to any of those URLs and what confuses us even more is that WebMaster doesn't show anything in the "Linked From" tab where it usually does for this type of errors, so we are wondering what this means, could be that they still in google's cache or memory? we are not really sure. If anyone has an idea of what this errors showing up now means we would really appreciate the help. Thanks. jZVh7zt.png
Technical SEO | | revimedia1 -
GWT False Reporting or GoogleBot has weird crawling ability?
Hi I hope someone can help me. I have launched a new website and trying hard to make everything perfect. I have been using Google Webmaster Tools (GWT) to ensure everything is as it should be but the crawl errors being reported do not match my site. I mark them as fixed and then check again the next day and it reports the same or similar errors again the next day. Example: http://www.mydomain.com/category/article/ (this would be a correct structure for the site). GWT reports: http://www.mydomain.com/category/article/category/article/ 404 (It does not exist, never has and never will) I have been to the pages listed to be linking to this page and it does not have the links in this manner. I have checked the page source code and all links from the given pages are correct structure and it is impossible to replicate this type of crawl. This happens accross most of the site, I have a few hundred pages all ending in a trailing slash and most pages of the site are reported in this manner making it look like I have close to 1000, 404 errors when I am not able to replicate this crawl using many different methods. The site is using a htacess file with redirects and a rewrite condition. Rewrite Condition: Need to redirect when no trailing slash RewriteCond %{REQUEST_FILENAME} !-f
Technical SEO | | baldnut
RewriteCond %{REQUEST_FILENAME} !.(html|shtml)$
RewriteCond %{REQUEST_URI} !(.)/$
RewriteRule ^(.)$ /$1/ [L,R=301] The above condition forces the trailing slash on folders. Then we are using redirects in this manner: Redirect 301 /article.html http://www.domain.com/article/ In addition to the above we had a development site whilst I was building the new site which was http://dev.slimandsave.co.uk now this had been spidered without my knowledge until it was too late. So when I put the site live I left the development domain in place (http://dev.domain.com) and redirected it like so: <ifmodule mod_rewrite.c="">RewriteEngine on
RewriteRule ^ - [E=protossl]
RewriteCond %{HTTPS} on
RewriteRule ^ - [E=protossl:s] RewriteRule ^ http%{ENV:protossl}://www.domain.com%{REQUEST_URI} [L,R=301]</ifmodule> Is there anything that I have done that would cause this type of redirect 'loop' ? Any help greatly appreciated.\0 -
Disallow: /404/ - Best Practice?
Hello Moz Community, My developer has added this to my robots.txt file: Disallow: /404/ Is this considered good practice in the world of SEO? Would you do it with your clients? I feel he has great development knowledge but isn't too well versed in SEO. Thank you in advanced, Nico.
Technical SEO | | niconico1011 -
Miss meta description on 404 page
Hi, My 404 page did not have meta description. Is it an error? Because I run report and seomoz said that a problem. Thanks!
Technical SEO | | JohnHuynh0 -
404 error - but I can't find any broken links on the referrer pages
Hi, My crawl has diagnosed a client's site with eight 404 errors. In my CSV download of the crawl, I have checked the source code of the 'referrer' pages, but can't find where the link to the 404 error page is. Could there be another reason for getting 404 errors? Thanks for your help. Katharine.
Technical SEO | | PooleyK0 -
Client error 404
I have got a lot (100+) of 404´s. I got more the last time, so I rearranged the whole site. I even changed it from .php to .html. I have went to the web hotel to delete all of the .php files from the main server. Still, I got after yesterdays crawl 404´s on my (deleted) .php sites. There is also other links that has an error, but aren't there. Maybe those pages were there before the sites remodelling, but I don't think so because .html sites is also affected. How can this be happening?
Technical SEO | | mato0