Why that many Crawl Diagnostics errors, false?
-
Hi,
my fist question, trying to understand how seomoz pro works.
I have about 680 crawl erros, but when I check the details, I found this:
1. many 403 errors ( I think from all links).
> I have tested my web site (telcelsolcom.com) in other tools and all says OK 200 response.
2. many title and content duplicates, but the system is showing as duplicated pages with and without the www.
> I have a 301 redirect from non www to with www and it is working ok.
Do I have false errors? What am I doing wrong?
thanks.
-
Thanks for your time Brent.
As far as I know I dont have any configuration that could block spiders. I have more sites in same sever without any issues, nothing special in .htaccess and some blocked directories in robots, thats it.
Actually google is indexing the web site very well (about 50% of urls submited two days ago).
I am sorry if next question sounds like blasphemy here in the comunity:
do these tools really works?
I dont want to expend time solving false errors. Also my free month is about to expire and would like to know it worth to pay next month.
-
Not really sure, but as I was trying to diagnose it, the site broke on me. Only after I sent my crawl tool to it.
So I am wondering if your server sees incoming spiders crawling, then blocks them. That would explain why both SEOmoz and my crawl tool came back with funny errors.
At first glance, I didn't see any issues. Not really sure.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Long-tail with few searches vs. Generic with many
Our business is a contract packager/manufacturer of products sold to very prominent brands who sell through retail. For example, we make the sunscreen under a brand’s name, which you might then find on the shelf in Target or CVS. As I’ve optimized our pages, I’ve attempted to go long-tail, which has been simply to add “…contract packaging” or a variation after the particular product. So, instead of trying to compete in “sunscreen”, which would pit me against big-box distributors and prominent brands and sellers of sunscreen, I’ve optimized for “sunscreen manufacturers.” “Sunscreen” has 31K – 72K searches, with an 81 Difficulty and 67 Potential. “Sunscreen manufacturers” has a low 13 Difficulty and a decent 54 Potential, but only 51 – 100 searches. Some of my terms have only 0 – 10 searches, but I’ve been thinking that it’s better to compete for fewer but more qualified / buyer-intent searches and have generally lower Difficulty. Can you please tell me if this is a smart strategy, or if I should instead try to compete in higher-volume terms but much greater Difficulty? Thanks a lot for everyone's help.
On-Page Optimization | | Beau_W0 -
PDF Instructions come up in Crawl report as Duplicate Content
Hello, My ecommerce site has many PDF instruction pages that are being marked as duplicate content in the site crawl. Each page has a different title, and then a PDF displayed in an iframe with a link back to the previous page & to the category that the product is placed in. Should I add text to the pages to help differentiate them? I included a screenshot of the code that is on all the pages. Thanks! Justin 9tD9HMr
On-Page Optimization | | JustinBSLW0 -
What to do with removed pages and 404 error
I recently removed about 600 'thin' pages from my site which are now showing as 404 errors in WMT as expected. As I understand it I should just let these pages 404 and eventually they'll be dropped from the index. There are no inbound links pointing at them so I don't need to 301 them. They keep appearing in WMT as 404's though so should I just 'mark as fixed' until they stop appearing? Is there any other action I need to take?
On-Page Optimization | | SamCUK0 -
Too many on page links in sitemap.html
My crawl report is flagging an issue with too many links to one of my pages, this page is my sitemap.html. However, I have coded the page so that if required is specified it generates an .xml version of the page and if not then the html version is displayed. What is the best way to stop the crawl finding the html version whilst maintaining it on the site for clients navigation?
On-Page Optimization | | SamPenno0 -
Too many outbound links on a page?
We have a "Clients" page on our site with approximately 125 of our clients listed. We have a link to each client's website, so that's 125 links. I am rethinking this approach. Is there any value to having these outbound links? The SEOmoz PRO analysis tells me I have too many links on this page. I have read that more than 100 links on a page is too many, but that seemed to be referring to internal links. Any thoughts? Thanks!
On-Page Optimization | | nyc-seo0 -
Error is not going away and crawling
I have fixed an error but its still showing in red as error. Im totally new to SeoMoz and to SEO in general so im not sure how this tool works. Did I fix it correctly or not if its still showing? It was a broken link and now it links up to another page. Do I just have to wait? My website only has 8 pages and on the dashboard it says crawled 8 pages but it takes up to a week for a full crawl? Im really confused. Thank you in advanced!
On-Page Optimization | | Pixeltistic0 -
Only 1 Page Being Crawled
I have a website I'm tracking www.alhi.com. But my report is saying that only 1 page is being crawled each update. My campaign is set up for the sub domain www.alhi.com, so I'm not sure why I would have this issue. Can you help? Thanks!
On-Page Optimization | | LeslieVS0 -
Too Many on page links
What is everyone's opinion on this? < 100 at all times? 100 -200 Okay? 200-300+ A little much?
On-Page Optimization | | MirandaP0