Question about robots.txt
-
Solved!
-
Just a friendly reminder. Please don't delete your question after it's been answered. It's very likely that someone in the future could have the same question and they would have been able to find the answer if you hadn't deleted the question.
-
Consider deleting all of this:
Disallow: /&limit
Disallow: /?limit
Disallow: /&sort
Disallow: /?sort
Disallow: /?route=checkout/
Disallow: /?route=account/
Disallow: /?route=product/search
Disallow: /?route=affiliate/
Disallow: /?marca
Disallow: /&manufacturer
Disallow: /?manufacturer
Disallow: /?filter
Disallow: /&filter
Disallow: /?order
Disallow: /&order
Disallow: /?price
Disallow: /&price
Disallow: /?filter_tag
Disallow: /&filter_tag
Disallow: /?mode
Disallow: /&mode
Disallow: /?cat
Disallow: /&cat
Disallow: /?product_id
Disallow: /&product_id
Disallow: /?route=affiliate/
Disallow: /*?keywordThose rules are telling Google not to crawl domain.com/EVERYTHING(then the URL parameter). This could be where the issue stems from. If you're worried about URLs with these things ranking, consider implementing canonical tags instead to point to the proper pages
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEO question
why does a business rank differ on google search and google maps (for example, a hair salon we do seo for ranks 5th for "hair salon in Dublin" on Google Maps and ranks 10th on Google search)
On-Page Optimization | | ryan.mamma0 -
Are there detrimental effects of having multiple robot tags
Hi All, I came across some pages on our site that have multiple robot tags, but they have the same directives. Two are identical while one is for Google only. I know there aren't any real benefits from having it set up this way, but are there any detrimental effects such as slowing down the bots crawling these pages? name="googlebot" content="index, follow, noodp"/> Thanks!
On-Page Optimization | | STP_SEO0 -
Usability-question on 2 of my websites
Hi all, It has been a while since I have been in this forum, but that's normally a great sign 🙂 Anyway these days I'm work on a "face-lift" on a couple of my sites (www.krydsord.dk, www.bingoforum.dk and www.alutagrender.dk), but also this face-lift should be more than just that. Hopefully it will help the usability to be better, and as a result of that - I hope it will make it easier for my visitors to easily find what they are looking for. The question is: I would like to ad, say, 25 words of description (mouse-over) in my top menu buttons. Why? Because, I believe that it's a possible problem that the menu just says "krydsord" (crosswords) in stead of a describing text saying something about "Push this button and you will see a complete list of all the cross words on Krydsord.dk). This way, I get the chance to add more text (for the Search Engines) and to guide my visitors in a way that I'm not capable of with the limitations my top menus give me as they are at this moment. Naturally, my visitors should be able to easily decline this "extra information", once they have got it once. Is this completely way off, or do you like the idea? More specifically: Will this be annoying for the visitors, will it have any positive effect on SEO matters? Actually I got partly inspired during a SEOmoz webinar (http://www.seomoz.org/webinars/designing-for-seo), even though it's not exactly what they are talking about in thwe webinar. For anybody who are curious (or just need to kill some time), you can have a look from 19:00 and watch it for about two minutes. Thanks a lot! Nicolai
On-Page Optimization | | MPO0 -
Google Index/Cashe questions
I have 15k+ pages. I have 4.5k pages indexed. What relation is the google cashe to indexing pages? My site gets cashed every two days. The competition in my SERP goes 2-3weeks to get cashed. What does this indicate? Is your cashe date your last google crawl? How can I get google to crawl my site? Is there a way I can get google to crawl my site starting from an internal page. This way I could set up a better linking structure that would benefit from doing activities that get that page indexed to help get my site indexed more thoroughly...
On-Page Optimization | | JML11790 -
Drupal SEO Question
Still trying to get a handle on all this...a lot to figure out! My site is Drupal and a few weeks ago I had my developer install an SEO Module so I could add a meta description and keywords for my pages. I have done that for the majority of the landing pages and the product pages as well. Earlier I posted a question about the use of adding the meta description and keywords to each product. The answers were mixed and pointed out the problem of the duplicate content which I am trying to figure out how to fix. BUT...when I went through my On Page Analysis grading for my campaigns one of the reasons my grades were low were because of the use of meta keywords tag. That the search engines ignore them and competitors can use them against you. So now I am thoroughly confused. I should optimize each product page with the meta description and keywords or i shouldn't? Keywords should show up in the title tag and the content....anywhere else? Help! Thanks much, Shara
On-Page Optimization | | Confections0 -
Title tag question
Hi, If I wanted to rank for 'cheap football boots' and 'football boots' which tag would be the best option: 1. Cheap Football Boots (notice both keywords im targeting are included) 2. Cheap Football Boots, Football Boots (both keywords separate) and the keywords sit on an EMD (cheapfootballboots.co.uk) Cheers
On-Page Optimization | | activitysuper0 -
Tags to index or to no index that is the Question
Sorry for the silly Shakespearean introduction but what are peoples opinions on leaving tag clouds to be indexed or no indexable by the search engines. I tend to leave them non indexable at the moment. I use wordpress for blogging as do most others.
On-Page Optimization | | onlinemediadirect0 -
Product Title Formating Question
The majority of the products I sell require lengthy product titles, I have 600+ items that have titles over 70+ characters. In the interest of reducing the character count (Product Feeds) I'm trying to eliminate unnecessary "stop words" in the titles, such as "and", "with" etc.. I've listed an example of a current product listing below, followed by two different formats to reduce the character count. Which one if any is better for SEO or should I leave my titles alone and stick with my original format? Current Listing Example: DeWalt Dual Comfort Safety Glasses with Black Frame and Clear Anti-Fog Lens Suggested Listing Example: DeWalt Dual Comfort Safety Glasses-Black Frame-Clear Anti-Fog Lens DeWalt Dual Comfort Safety Glasses/Black Frame/Clear Anti-Fog Lens
On-Page Optimization | | MEldridge0