Crawler reporting incorrect URLs, resulting in false errors...
-
The SEOmoz crawler is showing 236 Duplicate Page Titles. When I go in to see what page titles are duplicated I see that the URLs in question are incorrect and read "/about/about/..." instead of just "/about/" The shown page duplicates are the result of the crawler is ending up on the "Page not found" page.
Could it be the result of using relative links on the site? Anything I can do to remedy?
Thanks for your help!
-Frank
-
Hey Frank! This definitely sounds like an issue with relative links on the page; if the crawler sees it, he'll follow it, and continue to do so indefinitely, causing a super-long URL with the same sub-page listed over and over in the URL. I actually see this bug a fair amount. I'd recommend you look at your page code, try to find relative link tags, and then fix them on that side of things.
If you think it's a bug and nothing in your code, you can always send an email to us at help@seomoz.org - we'll be able to take a look and make sure it's not a bug on our side (make sure to send your PRO email address, the campaign with the issue, the URL with the issue, and any relevant screenshots/examples to help us diagnose). In my experience, though, this is always because of a relative link I find in the source. If you need help with how to fix that, you may want to start another thread here in the Q&A and post your page's source or URL. Hope this helps!
-
I am getting the same thing. I hope someone can help with this!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why is my MOZ report only crawling 1 page?
just got this weeks MOZ report and it states that it have only crawled: Pages Crawled: 1 | Limit: 10,000 it was over 1000 a couple of weeks ago, we have moved servers recently but is there anything i have done wrong here? indigocarhire.co.uk thanks
Moz Pro | | RGOnline0 -
Site Not Indexing & SEOMoz Reporting ZERO On-Page Report Crawls
Any help on this would be MUCH appreciated. One of my sites, aironeairsolutionsinc.com, has recently been rebuilt and the pages tweaked for some basic optimization. Based on my experience, those tweaks (geared toward keywords with relatively low competition locally) usually bump my local sites up into the top 20 or 30 at worst. 3 weeks later, it seems my site is still not indexing with Google. In addition, I AM NOTICING THAT THE ON PAGE REPORTS IN SEO MOZ ARE NOT REGISTERING THAT ANY PAGES ARE BEING CRAWLED. Again, any help from Moz staff would be awesome! :} Thanks, Ricky
Moz Pro | | RickyShockley0 -
How do i get the crawler going again?
The initial crawl only hit one page. Set up another campaign for another site and it crawled 260 pages. How can I get the crawler started up again or do I really have to wait a week ?
Moz Pro | | martJ0 -
Site Explorer Results - Linking Domains Tab
I have a competitor who has the following Linking Root Domains numbers on the Linking Domains tab and was wondering if some one could explain what the numbers mean? opera.com - 205,515
Moz Pro | | bridgeway04-34677
dmoz.org - 97,752 prweb.com - 198,092 quantcast.com - 115,748 tinyurl.com - 443,540 jquery.com - 57,886 URL: http://www.opensiteexplorer.org/domains?site=www.verypdf.com%2F Thanks, Brad0 -
After I make corrections of my crawl diagnostics report, how can I tell is those corrections "took". Is there a way to immediatly refresh that report. Will it eventually refresh?'
I have made corrections to the crawl diagnostics report. Can I refresh this report? I would like to see if my corrections were correct. Thanks for your anticipated answer!
Moz Pro | | Bob550 -
Using the On-Page optimization Report Card
I am curious if there is a way to get the on page optimization report card to not show a grade of "F" for a page that I'm not targeting a particular keyword for? For example my home page has a lot of grade "F's" for keywords that are targeted on different pages.
Moz Pro | | kadesmith0 -
How to read Crawler downloaded report
I am trying to seperate the duplicate title and description URLs, by looking at the report i am not getting how to find all urls which contain same title and description. Is there any video link on the site which walk me through each part of the report. Thanks, Punam
Moz Pro | | nonlinearcreations0 -
URLs getting re-directed to double http:// URLs
The "Notices" section under "Crawl Diagnostics" shows that there are 435 issues on my website. I checked out a few URLs to verify this issue and found that most of these pages are working perfectly. For instance, the above mentioned report shows that http://policycomplaints.com/about redirects to http://http://policycomplaints.com/about/ . Then, http://policycomplaints.com/aegon-religare/mis-selling-of-policy-by-aegon-religare/ redirects to http://http://policycomplaints.com/aegon-religare/mis-selling-of-policy-by-aegon-religare/ . However, when I open these pages, they seem to be working perfectly. I didn't find them getting re-directed to somewhere else. So, as per the report, it seems that all of these 435 http://URLs are getting re-directed to http://http://URL versions which in reality is not true because all the http://URLs are working perfectly. So, is this a problem with SEOmoz software? If not, what is the reason for these issues and how can I adddress them. Do notify if any further information is required for the same. Thanks. bNiEm.png
Moz Pro | | unknownID10