Question about robots.txt
-
Solved!
-
Just a friendly reminder. Please don't delete your question after it's been answered. It's very likely that someone in the future could have the same question and they would have been able to find the answer if you hadn't deleted the question.
-
Consider deleting all of this:
Disallow: /&limit
Disallow: /?limit
Disallow: /&sort
Disallow: /?sort
Disallow: /?route=checkout/
Disallow: /?route=account/
Disallow: /?route=product/search
Disallow: /?route=affiliate/
Disallow: /?marca
Disallow: /&manufacturer
Disallow: /?manufacturer
Disallow: /?filter
Disallow: /&filter
Disallow: /?order
Disallow: /&order
Disallow: /?price
Disallow: /&price
Disallow: /?filter_tag
Disallow: /&filter_tag
Disallow: /?mode
Disallow: /&mode
Disallow: /?cat
Disallow: /&cat
Disallow: /?product_id
Disallow: /&product_id
Disallow: /?route=affiliate/
Disallow: /*?keywordThose rules are telling Google not to crawl domain.com/EVERYTHING(then the URL parameter). This could be where the issue stems from. If you're worried about URLs with these things ranking, consider implementing canonical tags instead to point to the proper pages
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEO question
why does a business rank differ on google search and google maps (for example, a hair salon we do seo for ranks 5th for "hair salon in Dublin" on Google Maps and ranks 10th on Google search)
On-Page Optimization | | ryan.mamma0 -
Title-Tag question
The Yoast plugin is installed on the website. It generates the following meta property tag when I enter a new title-tag in the plugin: Next to that I have my standard title-tag. <title>dummy</title> Is this meta property tag able to replace the title-tag? Thanks!
On-Page Optimization | | WeAreDigital_BE0 -
Too Many on page links on my homepage question?
Question, on moz analytics, for my homepage, I've gotten the " Too many on page links" notification every crawl. I've always ignored it because i didnt think it affected ranking or anything really. The on page links on the bottom of our homepage are landing pages. Most users reach those pages by searching those specific pages on google. We just decided to put them on the bottom of our page for unknown reasons. My question is, should i remove the landing pages on the bottom of our homepage? WIll it improve search rankings for my homepage? if i do remove them, should i put the landing pages on another page besides the homepage? Does google index my website better without the on page links on my homepage? My website is- prestigeluxuryrentals.com
On-Page Optimization | | prestigeluxuryrentals.com0 -
Quick H1 Above the Fold Question
I was wondering if the H1 for this page was alright even though it is below the fold: http://www.seniorplanning.org/assisted-living-phoenix-arizona/. Any suggestions/comments would be very helpful. Thank you!
On-Page Optimization | | JacobEdward0 -
Different question for differnt purposes
Hi there! I have three questions I have used a wordpress plugin called WPML which translates a webpage into another language so that I have a webpage in two different languages (spanish (main market) and english). I'm just doing the seo for the spanish market and I'm gonna start with the seo for the english one. Should I do it just the same as I had a one-single-language page? just with english keywords, etc. I guessit would only differ in the way I do the linkbuilding strategy as the markets are diffent Should the pages I don't want to optimize with a specific keyword have its own title and description?. I only want them to get indexed by the the bot but not get found by a keyword in particular so that the their content is not very relevant. If my wordpress site "breaks down" and I just have to reinstall the entire site again. What kind of impact has in my SEO? I guess that if the crawler notices that my site is down it will have it into account (negatively) but ....what about the link-juice of my pages, etcc...? What collateral efects has a crash in my site. Thans in advanced.
On-Page Optimization | | juanmiguelcr0 -
Using Robots Meta Tag on Review Form Pages
I have gone over this so many times and I just can't seem to get it straight and hope someone can help me out with a couple of questions: Right now, on my dynamically created pages created by filters (located on the category pages) I am using rel""canonical" to point them to their respective category page. Should I also use the robots meta tag as well? Similarly, each product I have on my site has a review form on it and thus is getting indexed by Google. I have placed the same canonical tag on them as well pointing them to the page with the review form on it. In the past I used robots.txt to block google from the review pages but this didn't really do much. Should I be using the robots meta tag on these pages as well? If I used the robots meta tag should I noindex,nofollow? Thanks in advance, Jake
On-Page Optimization | | jake3720 -
Does Google Bias Against Homepages for Search Queries that are a Question?
If you are trying to rank for a keyword phrase that is a question (e.g. how to ___) does it matter if your page is the home page of your site or an article on your site? I suspect that Google would treat question search queries differently and would show preference for articles over a home page in most cases. An article would be more likely to satisfy the searcher by providing the answer to their question, whereas the home page usually doesn't provide specific answers. I looked at one keyword phrase that is a question and only 1 of the first 20 results was a home page. Any thoughts or experience with this?
On-Page Optimization | | Charlessipe0 -
Small Site Title Tag / Structure Question
Bit embarrassed to ask this question, but will ask it anyway! I have done some quite reasonable basic SEO for clients in the south of Spain with small sites and had reasonable success. My wife and I came to the Pyrenees in the south of France to take over and run bed and breakfast in a lovely old farm and some self-catering accommodation in one of the pastures (with my continuing to do a bit of work for clients too). We are running and developing the place for friends who are away 3-4 years. They had an abysmal site, so we designed one to together: http:www.loubetaspyrenees.com/ (I have given the French version because it's what I am most concerned with - there is an English version in case I can tempt you to a holiday here!) It's been very well received by users, so that's great. We have the place on about 12 agencies amd almost all link to our site, so it serves as a good showcase. Here's my issue (for the French site): It went online 11th Feb and is already doing well for more "long tail" searches, and for more local and specific searches, but is proving slow on our prime search terms. The prime market is French, and they key terms are "Gîtes" for the self-catering accommodation, and "Chambres d'Hôtes" for the Bed and Breakfast. Our key Geographical term for the French market is "Hautes Pyrenees" - it's a departmental area. In Google.fr We are around result 100 out of 600k results for "Chambres d'hôtes hautes pyrénées" and aren't in the first 200 for "Gîtes Hautes Pyrénées". This is a competitive market and we are competing with optimised and long-established agencies but still hope to do better. I know I am losing from poorly constructed title tags cannibablising the results, but cannot see how to solve this: Home Page Title tag: "Gîtes et Chambres d'Hôtes dans les Hautes Pyrénées | les Baronnies" I have two main pages on the Gîtes: Gîte for 2-3 people Title tag "Gîte dans les Hautes Pyrénées pour 2-3 personnes en les Baronnies"
On-Page Optimization | | PeterMurray
Gîte for 3-9 people Title tag "Location Gîte dans les Baronnies Pyrénées pour groupe 3-9 personnes" ("Location" means rental) Google understood the above and put us no 1 out of over 1miillion results for a search for a gite for 9 people in the south west of France ("gite sud ouest 9 personne") And 2 pages for the Bed and Breakfast: B&B in the farm building: "Chambres d'Hôtes dans les Hautes Pyrénées dans une ferme restaurée"
B&B in gite apartments with sitting rooms: "Chambres d'Hôtes dans les Hautes Pyrénées avec salon et terrasse" I am not sure how to handle the titles for the Home Page and for the 4 subpages - sounds silly, but have you any advice on how I might handle these titles better? I thought of using more general terms on the Home Page ("Holiday accommodation in the ..."), but on such a small site (18 pages in each language version) I feel that would be unwise. It seems I must try to find some way of differentiating the titles on the other 4 pages so that i am not cannibalising but where there are so few alternatives I am not sure how! Oh dear, sorry this was so long!0