Moz crawl showing up ?s=keyword pages as errors
-
Hi all,
Hoping someone can she some light on a fix with ref to wordpress and the search function it uses as Moz is craling some pages which reference the search
Errors showing up are duplicate pages, descriptions and titles.
The search function is not important on this site and I have tried to use a plugin which disables the search page which it does but these errors still show up. Can anyone assist as this is the final piece of the puzzle and then we're down to 0 issues on the site.
-
I have implemented the robots method for the moment and I will look at the exclusion of parameters too. thanks , i will now wait the next crawl from Moz .
-
Hi there,
I am not sure which fix will stop Moz from flagging this, but just in case it is also being picked up by Google, are you able to serve the canonical tag on domain.com/?s=keyword and any search query pages, pointing to a generic page?
You can remove parameters from Google in Webmaster Tools as well: https://support.google.com/webmasters/answer/1235687?hl=en
This ensures that Google does not crawl pages with the parameter you specify, meaning they won't be an issue in its index.
-
Different ways to do this - best way would be to eliminate the search from your template in the editor files. If you want Moz to stop crawling your internal search pages add this to your robots.txt file:
User-agent: RogerBot
Disallow: /?s=*?
This should block Moz's crawler from any page beginning with _/?s= _after the root domain. Do a regex test just to double check your internal search URL and that piece of regex.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Joomla Core Pages Delisted
Hey Everyone, This query may be more for a Joomla developer or someone that has had a similar issue. I'm not really looking for answers like, "check Google Search Console" or anything like that. We have a client who recently had all of their core pages delisted in Google but the blog is still being displayed in search results. For example, if you search "company name" they have a blog post that ranks #13 or so organically. I tested Google Search Console and Google is saying that the site is temporarily unavailable. We haven't made any changes or updates to Joomla's core structure so I'm unsure as to where this change is coming from. Here are some items we've checked: 1. Site searches within Google, resulted in seeing core pages are not indexed but blog pages are 2. Google Search Console - looked for manual actions (none found), looked at sitemap errors (nothing mentioned), looked at robots.txt (no issues here), attempted to fetch the site as Google (temporarily unavailable). 3. Called the hosting company (Rackspace) to discuss potential issues. They were extremely helpful but we were unable to find anything. The blog is actually a Module that was added so I'm thinking something has changed to block Google bots from the core Joomla structure but it hasn't blocked them from the blog structure. Without putting the company name or url on blast, has anyone heard of or experienced anything like this? Any help or insights would be much appreciated!
Web Design | | Leadhub0 -
Who's best but affordable custom shopping cart provider (e.g. 3dcart, big commerce, shoppingcart)?
I'm planning to put up a buy and sell site for shoes where people can upload shoe listings on their own something like ebay.com though we're not the ones who will process the payment. The site we're planning doesn't have a buy/checkout button and paypal integration so it will look like a catalog. We will just add a contact number/email in the product listing so a buyer can contact and personally meet the seller. Let me know if this can be done in Wordpress + e-commerce plugins. I would also like to know if there are custom shopping cart providers that allow Facebook or Twitter login/sign up integrated in the platform. Let me know if this is also possible in Wordpress by adding a plugin. Thanks in advance!
Web Design | | esiow20130 -
New website put up and ALL my keywords fell a LOT!???
I helped a client redesign their new website and we just went live a couple weeks ago. This morning I checked his campaign and 53 keywords fell DRAMATICALLY. Like 35-50 places down in Google for dozens of keywords!? I haven't ever seen a drop that's so dramatic when putting up a new site. Have you ever seen this? Will they bounce back? This site isn't significantly different than the last one. We did forward two other domains to this new site but that wouldn't make a difference, would it? Any feedback would be greatly appreciated! Matthew
Web Design | | Mrupp440 -
Tons of 404 errors - wordpress permalink structure
hi all, noticed my crawl report is showing a ton of 404 errors. my site is running on wordpress, and i believe this is related to a change in my permalink structure (all of the pages do exist, but the url is slightly different). how does the crawl report find these 404s? When navigating around my site, the correct pages are accessible, but the report is seeing the old URL structure for some reason. Do these live in the sitemap? How can this be corrected? thanks so much for your help!
Web Design | | lsat0 -
Changing URL's for a website redesign
Hi folks, We're redesigning our website and looking for some advice on how changing our URL's would affected our rankings. If the page URLs are changing how can we carry out redirects to avoid losing any SEO rank? Thanks, Ross
Web Design | | Will_Craig0 -
Site Ranks on Page 1 - Would launching new site hurt that
Hello, I currently have a website ranking in the top 7 for my main keyword. The website was built in 2004 and is definitely outdated, yet still ranks very high and brings in business. If i launched a new site on this domain, what would happen to my rankings? Would they drop? would they rise? If i don't launch the new site, will this site eventually drop due to being old and outdated? Any advice would be helpful...
Web Design | | Prime850 -
Does page speed worth for SEO?
I always broken my head to try to follow all pagespeed guidelines. I increase my pagespeed significantly, but i didnt saw any effect in my SEO performance. In my keywords, my concorrents are crap on it (I have score of 90 and they are at 60-70).Does google gives importance to it?
Web Design | | Naghirniac0 -
Order of my products on page?
Hi, I read somewhere that Google reads a page in a certain way. All my product pages are listed (or most of them) in Alphabetical order. Now say I am targeting brands named Cruyff and Money Clothing, should I put all the Cruyff and Money products above everything else? See here for example... http://www.designerboutique-online.com/jackets/ They are in Alph order, except the sales items at the bottom. So would it be beneficial to do this? To put my targeted brands at the top of the page? And if not, is there anything I should be doing with the layout of the products to improve/help with SEO? Thanks Will
Web Design | | WillBlackburn0