Best way to fix 404 crawl errors caused by Private blog posts in WordPress?
-
Going over Moz Crawl error report and WMT's Crawl errors for a new client site... I found 44 High Priority Crawl Errors = 404 Not Found
I found that those 44 blog pages were set to Private Mode (WordPress theme), causing the 404 issue.
I was reviewing the blog content for those 44 pages to see why those 2010 blog posts, were set to private mode. Well, I noticed that all those 44 blog posts were pretty much copied from other external blog posts. So i'm thinking previous agency placed those pages under private mode, to avoid getting hit for duplicate content issues. All other blog posts posted after 2011 looked like unique content, non scraped.So my question to all is: What is the best way to fix the issue caused by these 44 pages?
A. Remove those 44 blog posts that used verbatim scraped content from other external blogs.
B. Update the content on each of those 44 blog posts, then set to Public mode, instead of Private.
C. ? (open to recommendations)I didn't find any external links pointing to any of those 44 blog pages, so I was considering in removing those blog posts. However not sure if that will affect site in anyway.
Open to recommendations before making a decision...
Thanks -
Hey Alberto,
If those 44 posts are set to "private" how is Moz finding them? Somewhere in your blog you are linking to them. Find those links and take them down.
Then you should consider 2 things:
- Do those pages get any organic traffic? If yes, try to create a page that isn't a copy, with unique and useful content and set it as public.
- If there's no organic traffic, then just leave the 404 and just make sure your 404 is a nicely designed 404 that offers some value to the user. Not only for these 44 pages, but to cover any 404 issue in the future too. You could, for example, check the URL requested and search our site for related content and while saying that the page they were looking for is missing/removed, you suggest looking those other pages.
Hope that helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Default Wordpress 301 Redirects of JS and CSS files. Bad for SEO & How to Fix?
Hi there: We are developers with some digital marketing expertise, but a current issue has us perplexed. An outside SEO firm has asked us to clean up a large number of 301 redirects. Most of these are 'default' Wordpress behavior that relate to calling the latest version of a JS or CSS file. For instance, a JS file is called with this: https://websitexyz.com/wp-includes/js/wp-embed.min.js?ver=4.9.1 but ultimately redirects to this: https://websitexyz.com/wp-includes/js/wp-embed.min.js. We are being asked to prevent the redirect from happening by, presumably, calling the ultimate file to begin with. The issue is that, as far as we know, there's no easy way to alter WP behavior to call the ultimate file to begin with. Does anyone have any thoughts on this? Thanks.
Intermediate & Advanced SEO | | Daaveey0 -
The Value of Backlinks - Blog posts
Alright, So I'm trying to understand the value of a backlink from a blogger/site owner. Now, as I know, (let's use fashion industry), there are thousands of fashion bloggers with good metrics... Domain Authority 40+ Page Authority 40+ etc. etc. for their home page. And there are THOUSANDS of fashion bloggers that link back to ecommerce sites (backlinks). My question is, is there really much of a value with these backlinks? Sure, the domain authority and page authority is high ( for the given example), BUT wouldn't the page authority automatically be a 1 for a "post" ? Le'ts say one blogger writes a new blog for July 14th and dedicates that blog post about the awesome shoes they have and it links back to an ecommerce site; well, what impact does that make in regards to SEO? And if it does, how long would that take? The biggest issue I see is the ROI. You link build, you get links - and then ....you wait. Or you hope that you'll move up in rankings, but yet they can take months for it to even move the needle. Especially the fact that if it's not a HOME PAGE link...there isn't that "much" of a boost compared to an internal page? So then the NEXT question I have too, wouldn't influencer outreach be the same as far as getting a PBN link, creating web 2.0's, etc.? Let's think about it. You're outreaching to someone so you can benefit something back. It's all unnatural at the end of the day. Would love to discuss. So in summary 1 - Value of influencer outreach links - especially if the post is a brand new content piece.. (page authority being automatically 1) 2- - What exactly IS white hat when really any type of link building is mimicking?
Intermediate & Advanced SEO | | ggpaul5620 -
What's the best way to A/B test new version of your website having different URL structure?
Hi Mozzers, Hope you're doing good. Well, we have a website, up and running for a decent tenure with millions of pages indexed in search engines. We're planning to go live with a new version of it i.e a new experience for our users, some changes in site architecture which includes change in URL structure for existing URLs and introduction of some new URLs as well. Now, my question is, what's the best way to do a A/B test with the new version? We can't launch it for a part of users (say, we'll make it live for 50% of the users, an remaining 50% of the users will see old/existing site only) because the URL structure is changed now and bots will get confused if they start landing on different versions. Will this work if I reduce crawl rate to ZERO during this A/B tenure? How will this impact us from SEO perspective? How will those old to new 301 URL redirects will affect our users? Have you ever faced/handled this kind of scenario? If yes, please share how you handled this along with the impact. If this is something new to you, would love to know your recommendations before taking the final call on this. Note: We're taking care of all existing URLs, properly 301 redirecting them to their newer versions but there are some new URLs which are supported only on newer version (architectural changes I mentioned above), and these URLs aren't backward compatible, can't redirect them to a valid URL on old version.
Intermediate & Advanced SEO | | _nitman0 -
Sitemaps during a migration - which is the best way of dealing with them?
Many SEOs I know simply upload the new sitemap once the new site is launched - some keep the old site's URLs on the new sitemap (for a while) to facilitate the migration - others upload both the old and the new website together, to support the migration. Which is the best way to proceed? Thanks, Luke
Intermediate & Advanced SEO | | McTaggart0 -
Sitemap error
Hey Guys Everytime I run the tester through google webmaster tools - I keep getting an error that tells me "Your Sitemap appears to be an HTML page. Please use a supported sitemap format instead." An idea how to go about fixing this without changing the site around? https://www.zenory.co.nz/sitemap I have seen competitors sitemaps look similar to mine. Cheers
Intermediate & Advanced SEO | | edward-may0 -
404 in Google cache for one of my blog posts
Hey Moz People, I'm getting a 404 when I cache: this blog post http://www.inscopix.com/blog/decoding-brain-initiative and I'm not able to see what's causing it. Can someone take a look and let me know if they see anything standing out? Thanks,
Intermediate & Advanced SEO | | jacobfy0 -
Best way to migrate to a new URL structure
Hello everyone, We’re changing our URL structure from something like this: example.com/index.php?language=English To something like this: example.com**/english/**index.php The change is implemented with mod_rewrite so all the old URLs can still work We have hundreds of thousands of pages that are currently indexed with the old URL structure What’s the best way to get Google to rapidly update its index and to maintain as much ranking as possible? 301 redirect all the old URLs to the new equivalent format? If we detect that the URL is in an old format, render the page with a canonical tag pointing to the new equivalent format as well as adding a noindex, nofollow tag? Something else? Thanks for your input!
Intermediate & Advanced SEO | | anthematic0 -
Shall I fix "most Common Errors" for a website that ranked top 3 on Google (difficult KW)?
How can SEOmoz "most Common Errors*" under "Crawl Diagnostics" advice can be right for a good site organic? Site is well ranked top 3 on Google (difficult KW). If I go ahead and fix these errors, I might hurt my SEO , no? like: Too Many On-Page Links 302 (Temporary Redirect) Title Element Too Long (> 70 Characters) Missing Meta Description Tag
Intermediate & Advanced SEO | | Elchanan0