Why that many Crawl Diagnostics errors, false?
-
Hi,
my fist question, trying to understand how seomoz pro works.
I have about 680 crawl erros, but when I check the details, I found this:
1. many 403 errors ( I think from all links).
> I have tested my web site (telcelsolcom.com) in other tools and all says OK 200 response.
2. many title and content duplicates, but the system is showing as duplicated pages with and without the www.
> I have a 301 redirect from non www to with www and it is working ok.
Do I have false errors? What am I doing wrong?
thanks.
-
Thanks for your time Brent.
As far as I know I dont have any configuration that could block spiders. I have more sites in same sever without any issues, nothing special in .htaccess and some blocked directories in robots, thats it.
Actually google is indexing the web site very well (about 50% of urls submited two days ago).
I am sorry if next question sounds like blasphemy here in the comunity:
do these tools really works?
I dont want to expend time solving false errors. Also my free month is about to expire and would like to know it worth to pay next month.
-
Not really sure, but as I was trying to diagnose it, the site broke on me. Only after I sent my crawl tool to it.
So I am wondering if your server sees incoming spiders crawling, then blocks them. That would explain why both SEOmoz and my crawl tool came back with funny errors.
At first glance, I didn't see any issues. Not really sure.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Page Optimization Error
Hi, I am trying to track a page optimization feature for one of my project, https://shinaweb.com but i keep getting this below error: "PAGE OPTIMIZATION ERROR
On-Page Optimization | | shinawebnavid
There was a problem loading this page. Please make sure the page is loading properly and that our user-agent, rogerbot, is not blocked from accessing this page." I checked robots.txt file, it all looks fine. Not sure what is the problem? Is it a problem with Moz or the website?0 -
Hreflang Errors 404 vs "Page Not Found"
For a websites that differ between catalogs (PDPs) what hreflang error causes the least harm? Obviously the best solution is to only have hreflang for shared products, but this takes more work to implement. So when no identical product exists... 1. Hreflang points to 404 or 410 error. 2. Hreflang points to 200 status "Page Not Found" page. This obviously has the additional issue of needing to point back to 100+ urls. I want to avoid having Google decide to ignore all hreflang due to errors as many correct urls will exist. Any thoughts?
On-Page Optimization | | rigelcable0 -
I am trying to use Page Optimization feature but it is giving me error.
Hi, I am trying to track a page optimization feature for one of my project, https://www.360degreespropertyinspections.com.au for keyword: property inspections melbourne but i keep getting this below error: "Page Optimization Error There was a problem loading this page. Please make sure the page is loading properly and that our user-agent, rogerbot, is not blocked from accessing this page." I checked robots.txt file, it all looks fine. Not sure what is the problem? Is it a problem with Moz or the website?
On-Page Optimization | | Abhijay191 -
How many product subcategories are ok?
Let's say I have a sea glass ankle bracelet. On my site, my main keyword is "Sea Glass Jewelry" and have ranked relatively well for this, but this main page has over 200 products in it. I thought that if the URL has the keywords in it, it would be beneficial. I also have a section for all my bracelets, so it would be there and then, a more specific ankle bracelets category. So, technically, an ankle bracelet will show up 3x. Sea Glass Jewelry (all products go here) Bracelets (all bracelets go here) Ankle Bracelets (only ankle bracelets) The URL is only attached to the main category so to speak. If you click the ankle bracelets category, the url will still revert back to the original main category: seaglassjewelry/sterlinganklebracelet so I don't believe there is duplicate content. I have had my domain for years and it has ranked well until someone hacked into my site 2 years back. I have never been able to recover from this loss. Since then, I have tried to optimize my site, but nothing seems to be working and I just want to make sure that I am not hurting my ranking by doing this. Can someone confirm this is the best way to do it or make a suggestion? Thank you.
On-Page Optimization | | tiffany11030 -
Too many posts in a category?
Does having a post in too many categories have a negative effect on SEO? I have some posts in around 15 categories on my site.
On-Page Optimization | | SamCUK0 -
How does a keyword get crawled and pointed at a certain page
I was wondering if you can give me some insight on how a keyword that I put on my campaign gets linked to a specific URL on my website by SEOMoz or Google. For example: updating a brick fireplace is my keyword. On the campaign when I am looking at my on page optimization, the URL assigned (or given) to it is my homepage. How is this determined and is there a way around it and or directing it to the correct page? Thanks
On-Page Optimization | | SammyT0 -
How to trace back a link from a 404 error?
How do I find the link that is still refferring to a 404 error? Somewhere on my site there is a link pointing to an un-usable page and I cant find where that link is to fix the 404 error. I could just delete the page all together, but I would like to find the problematic link first.
On-Page Optimization | | AtoZion0