URL 404 errors after crawl? HELP!
-
I am getting Crawl errors. It shows multiple pages as. I know this is more of a technical question however, I cannot find the answer anywhere. I'm using wordpress
www.mydomain.com/title-of-page/mydomain.com/contact
WHAT IS THIS?!
-
Dan...
You may just be the man! It ended up being a widget created specifically for the theme, that didn't have the absolute path to the contact page. It was very simple to fix. Thank you
-Christine
-
Christine
Thanks for providing the site name to me via PM - won't reveal the site here, but I see the issue.
The contact link in your footer should always lead to the contact page;
However, it is adding the subfolders of whatever directory you are in. If you are on the page
it is linking to;
In which, of course, no contact page exists at that URL.
You need to find where the footer links are being created in your WordPress setup - options are;
- Could be in the theme settings
- Could be in a widget
- Could be "hardcoded" into the footer.php file (although I doubt it)
And see if you can enter the link to the contact page just as an absolute link (not a relative link) explanation on this page
In other words, you want the link in your footer to ALWAYS point at http://www.yourdomain.com/contact/
If this does not fix it, you may need to go into the "editor" and find the footer links in the footer.php file - where you can change the link to reflect the absolute path of the contact page.
If still at a loss, contact the help folks for your WordPress theme, cause this sounds like a theme issue if the mistake isn't on your end, this definitely has nothing to do with Yoast.
Hope that helps!
-Dan
-
Christine
Can you tell us (or me via PM) the site? The Yoast plugin is bulletproof unless something else is messing with it. I won't reveal the site if you don't want me to, but will post an answer back here in the Q&A.
Thanks!
-Dan
-
Thanks Dan, I just ran that program (which was awesome) and yes i am still having errors. Im using a plug in by Yoast called Wordpress SEO plugin. Im still encountering the errors. Im thinking i need to disable the plugin all together.
So.... Not sure how to fix it. Do i redirect the bad URLS somewhere? (even thought they dont even technically exist?)
Any help is appreciated. thanks
-
Hi Christine
Just checking in here - are you still having trouble?
I would advise running the site through Screaming Frog and checking Webmaster Tools for the presence of the same crawl errors.
Screaming Frog should tell you if/where you currently have bad links on the site. Always good to double check with another tool.
Let us know, thanks!
-
screen share?
-
I am using a plugin SEO by Yoast, i checked the structure in place, seems ok to me.
when i visit the pages, the error doesn't come up. only when the pages are indexed in crawled do i get those errors.
So I dont know where it is finding those links.
-
You simply forgot to put http:// before mydomain.com/contact
-
Also, if you want to PM me your login details I'll be glad to take a look.
You can check my tested eLance scores at atlantamedia.elance.com.... just so you know I won't mess anything up
-
Hi Christine,
This looks like some kind of misconfiguration in Wordpress that's probably being caused by your permalink structure. If you've installed any plugins lately that change your permalinks, try deactivating them and see if the problem remains.
Looks to me like the permalink structure or template is just repeating itself, so instead of going to yoursite.com/page it's going to yoursite.com/page/yoursite.com/page.
Should be an easy fix if you find the offending plugin or setting.
It could also be caused if you have manually linked to certain pages, and then changed your permalink structure, making the links that were correct before the change now point to pages that don't exist.
If you're site is working fine and you can't find the links pointing to the 404 pages, you can use Google Webmaster Tool's URL removal to stop them from being indexed, or add them to your robots.txt file via the Disallow command.
Hope this helps!
Anthony
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Help optimizing website for speed
Hello, My website is www.likechimp.com and is a University project. I need to optimise the website for speed as the bounce rate is fairly quick - I feel this could be due to how long it takes web site to load? Any tips in increasing internet speed. I am willing to higher someone if they feel they can help! Thanks, L
On-Page Optimization | | xlucax0 -
301 vs. keeping identical URL
Hey everybody! I have a question pertaining to our redesign. The situation is as follows: /drug-rehab/alcohol-withdrawal-los-angeles gets a decent amount of views on out website, and we would like it to be on our redesigned site. I was curious what impact, if any, I would see given the two scenarios below. 301 to /alcohol-withdrawal make the new page /drug-rehab/alcohol-withdrawal-los-angeles as well The second situation is that there are a serious of other pages which don't seem to be of drastic benefit, which I don't feel NEED to be on the website. For example: /post-acute-alcohol-withdrawal-treatment/drug-los-angeles /rehabs-resources/drug-abuse/sub-acute-alcohol-withdrawal etc It appears to me that the content on these pages is rather similar, and I feel like they don't really say anything special. Can I 301 them to the new page? Should I let them die in the black hat inferno they were made in? Any thoughts are greatly appreciated! Thanks guys!
On-Page Optimization | | HashtagHustler0 -
Short URL's vs Optimised URL's
Howdy Mozzers! What are your thoughts on short URL's vs Optimised URL's. For example if a website currently sells wood furniture and wants to target the keyword "Wood Furniture For Sale", which URL would be preferable: Short URL: www.domain.com/wood-furniture Optimised URL: www.domain.com/wood-furniture-for-sale The website also uses facet navigation and selected attributes are added in a fixed order sequence after the category. For example if Cane is selected as wood type: Short URL: www.domain.com/wood-furniture/Cane Optimised URL: www.domain.com/wood-furniture-for-sale/Cane Which one do you prefer (between the short URL and optimised URL) and why? Cheers! MozAddict
On-Page Optimization | | MozAddict0 -
Dealing with Not Found errors
Hi, I have a problem with Google Webmaster, it reported that I have many errors 404 Not Found.
On-Page Optimization | | JohnHuynh
I have detected and found the links are coming from my site, I have fixed them and submit a new sitemap to google again. Then, I wait a few days, google still report errors 404 Not found same as before. I don't know why? Please help!0 -
Help, a certain directory is not being indexed
Before I start, dont expect this to be too easy. This really has me puzzled and am surprised I am still yet to find a solution for it. Get ready. We have a wordpress website, launched over 6 months ago and have never had an issue getting content such as pages and post pages and categories indexed. However, I some what recently (about 2 months ago) installed a directory plugin (Business Directory Plugin) which lists businesses via unique urls that are accesible from a sub folder. Its these business listings that I absolutely cannot get indexed. The index page to the directory which links to the business pages is indexed, however for some reason google is not indexing all the listing pages which are linked to from this page. Its not an issue of the content being uncrawlable or at least dont think so as when I run crawlers on my site such as xml sitemap crawlers it finds all the pages including the directory pages so I am sure its not an issue of the search engines not finding the content. I have created xml sitemaps and uploaded to webmaster tools, tools recongises that there are many pages in the xml sitemap but google continues to only index a small percentage (everything but my business listings). The directory has been there for about 8 weeks now so I know there is a issue as it should of been indexed by now. See our main website at www.smashrepairbid.com.au and the business directory index page at www.smashrepairbid.com.au/our-shops/ To throw in a curve ball, in looking into this issue and setting up tools we noticed a lot of 404 error pages (nearly 4,000). We were very confused where these were coming from as they were only being generated from search engines - humans could not access the 404s and so we are guessing se's were firing some javascript code to generate them or something else weird. We could see the 404s in the logs so we know they were legit but again feel it was only search engines, this was validated when we added some rules to robots.txt and we saw the errors in the logs stop. We put the rules in robots txt file to try and stop google from indexing the 404 pages as we could not find anyway to fix the site / code (no idea what is causing them). If you do a site search in google you will see all the pages that are omitted in the results. Since adding the rules to robots, our impressions shown through tools have jumped right up (increased by 5 times) so thought this was a good indication of improvement but still not getting the results we want. Does anyone have any clue whats going on or why google and other se's are not indexing this content? Any help would be greatly appreciated and if you need any other information to assist just ask me. Really appreciate anyone who can spare their time to help me, I sure do need it. Thanks.
On-Page Optimization | | ziller0 -
Cnnonical Issue! Plz Help
Hi, I'm having this problem for one of my website, say www.abc.com. Certain information in the site is long and thus required to be put into several pages. For example, let say there is a section for the "List of Business Schools in Canada", this is a huge list and thus divided into several pages. The main URL is like this www.abc.com/business-schools/list-of-business-schools-in-canada.html & after on its goes on like www.abc.com/business-schools/list-of-business-schools-in-canada1.html www.abc.com/business-schools/list-of-business-schools-in-canada2.html www.abc.com/business-schools/list-of-business-schools-in-canada3.html Etc. Now as Google is considering these pages as canonical what should I do suppose do what with it? I've examine that rel="canonical" tag is used on every pages (canada1.html, canada2.html etc.) and the canonical URL is set to the main list-of-business-schools-in-canada.html page. So, why is that Google is picking this up as canonical? Have I made a mistake in placing the rel= canonical tag ? Please suggest. Thanks in advance,
On-Page Optimization | | ITRIX0 -
Should I include my help desk link?
My website has a link to our help desk. I was considering a 'do not follow' since I don't think it should be included. However, are there any benefits to including it since there are A LOT of articles and pages on our help desk (though it's aimed at our curent customers, not new or potential customers)?
On-Page Optimization | | flightoffice0 -
How do you see a list of URLs with duplicate page titles?
When looking at the Duplicate Page Title report, the Other URLs column has various numbers that presumably indicate the number of pages that share the same title. When I click on one of these numbers, say a URL that shows 4 in that column, the next page reports "No sample duplicate URLs to report". Why isn't it showing me the other 3 URLs with the same page title?
On-Page Optimization | | jkenyon0