Issue with a particular command of robots.txt! Help needed!
-
Hi all,I'm facing a strange issue with a website: www.foodmood.itI've written this robots.txt: www.foodmood.it/robots.txt in which I'm using all commands I've tested and used on other websites.The problem is that this website is not indexing correctly, and my fear is that I've written the robots in a wrong way.In this forum I've been taught that this command Disallow: /*? should be substituted with Disallow: /? in order to be sure the crawler is not indexing all the URLs containing a question mark.My question is: do you think this command modified in the above way can cause a problem to my website?I repeat that I've used it on several sites and this is the first time I'm having this kind of problems.Thanks in advance for your help.A.
-
I would in future tend to trust sources closer to being official rather than someone on a forum. Remove the extra * so its just Disallow: /*?
You can find more info here - https://support.google.com/webmasters/answer/156449
You can also test your robots in your webmaster tools so don't forget to give that a go if in doubt.
Hope that helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
IE & Edge issues with site relaunch - advice appreciated
Hi, I've been involved in a major ecommerce site relaunch, redesign and backend and have been involved in several successful ones before. On the whole things have gone great. Of course there are some minor bugs to fix, rendering issues etc but my real concern is a significant decline in conversion rate BUT only for IE and Edge users. All other major browsers conv rate has increased. Trawling through analytics and the site itself in those browsers there is no obvious sticking points e.g bounce rate has improved on all browser inc IE & Edge, no particular point in the funnel is suffering more than others, no particular page or landing page is doing much worse than others etc. it just seems like all the kpi's (except bounce) are down a little on the 2 microsoft browsers, which has a significant impact. One of the things that changed on relaunch is that we moved to https and im wondering if that might be causing an issue with IE / Edge security or privacy settings or that functionality on the site that relies on cookies is being affected, though in testing we haven't come across anything. I'd appreciate any advice or insight. Thanks, Andy
Conversion Rate Optimization | | AndyMacLean0 -
HELP: Analysing data to make decisions, SEO vs PPC
Hi mozers! I have recently been seeing good results in the serps lately for my main keywords in my country NZ, now I'm seeing good results in Australia for these keywords and our USA domain is not far behind and making good progress... However, our NZ results show that we may get around 1 conversion every 3 days from our organic search. I read other places that click share for ppc was much higher, but there is no way we can match our competitors budgets from 3k - 300k per month. So our option was to focus on SEO. To me, the SEO results seem quiet low, however I'm not really sure how to go about diving deep into the analytics of it all to find out where I need to improve or focus on, which keywords are bringing these conversions. Maybe I need to go for long tail keywords etc... It seems my rankings are coming from general keywords which are still highly competitive, but even so, we are not performing to what I know we should be. Our competitors are mostly paying ppc, however I was told my ROI would be better spent via SEO. Any suggestions perhaps what I might be missing or doing wrong in this case. (I have recently done a new design overhaul with a new registration process) I have 3 top level domains you can see the site here http://bit.ly/1yhz96v
Conversion Rate Optimization | | edward-may0 -
Help with ecommerce duplicate pages and SEO advice(magento base site)
Hi, We have a magento build site (www.mokee.eu) and are selling our own branded goods. So far it is a very limited range of products. It's 1 baby crib in 5 variations. We recently started getting more sales from the site, so I started to look a bit more into optimising our site. I rewrote item name, created better descriptions, added meta titles and description etc. and subscribed to the MOZ analytics platform to understand a bit better ways to improve things up. From what I saw we have a big issue of duplicated content because our product pages are the same and only the product colour changes, which is something google apparently doesn't like However it is important for us that each colour get referenced by google so people who search for grey cot can find a picture of our grey cot etc... Also I was thinking to create only on multi variation page with all colour but when you have only 1 product to sell it might look a bit empty on the site. 1- Do you guys have some advise on how to go round this issue? 2- Do you have any other advise for my site in particular to optimise things and actually do you think i should be worried at all with such a small catalogue? Thanks Sam
Conversion Rate Optimization | | mokeestore0 -
Help Me Improve this Page, Please
Time for the weekly "help me improve this page" post 🙂 I'd appreciate it if you all would take a look at this page and give me some tips to improve it from a user - point - of - view. The URL is http://goo.gl/9mcyF My main goal is conversions and I'm trying to make this page as good and helpful and easy as possible for potential buyers and visitors. I'd appreciate any tips or suggestions that you think may help. Thanks!
Conversion Rate Optimization | | Prime851 -
Need Advice on Home page Conversion Rate Improvement - not much $$s
Anyone out there have some suggestions for how I can improve my home page and increase my lousy conversion rate? I've spent years on the content and SEO optimization of my site and very little time on making a home page that sells stuff. Caveat - I don't have the money to go to one of those fancy companies who do a complete makeover and charge in the tens of thousands. Any suggestions would be greatly appreciated! Jean http://www.northwest-wine.com
Conversion Rate Optimization | | JeanYates0 -
I am trying to make my site a better user experience please help
Hi, i want someone to review my site and let me know what steps i need to do to make it a better experience for the user and to lower my bounce rate which is about 67 at the moment. I am trying to get the advertising and the user friendly to match, i need the adverts to make money and need to make sure i have them in the right place so they get clicked more. I want to reduce my bounce rate and want people to not just read one page but to go to different pages and would like advice on what i need to do. here is the site http://www.in2town.co.uk and here are the example pages that i would like to focus on to increase the user friendly and keep people on my site while making sure i have the adverts in the right place http://www.in2town.co.uk/news/gossip-celebrity/alex-reid-says-he-is-fed-up-with-chantelle-houghton-lies http://in2town.co.uk/news/travel-holiday-news/sainsburys-customers-10-points-back-on-easyjet-flights-with-nectar http://in2town.co.uk/news/small-business-news/how-emerging-technology-can-help-reduce-small-business-costs I am looking for ideas on how to increase the experience and how to keep people longer on my site while at the same time have people clicking the ads by increasing the conversion rate.
Conversion Rate Optimization | | ClaireH-1848860 -
Need advice on google adsense positioning
Hi my site www.in2town.co.uk gets a few thousand visitors a day but i am having trouble making any money from google adsense and this is because i am no good at advertising or understand it. I have tried many formats and i just cannot understand the correct way to do it and would really like some help and advice in what i am doing wrong. Would really love to see some magazines that do google adsense to see where i am going wrong. Here is one page from my site with google adsense http://www.in2town.co.uk/news/health-women/nearly-one-in-four-women-risk-skin-cancer-by-not-wearing-sun-tan-lotion and here is another example http://www.in2town.co.uk/latest-business-news/business-expert-says-franchise-opportunities-are-a-great-way-to-start-a-business If anyone can please help me understand what i am doing wrong please, then that would be great.
Conversion Rate Optimization | | ClaireH-1848860 -
Can I track user journeys from a particular source?
We want to track users from a particular campaign to see what they do when they get to the site. The site generates revenue from clicks out so we want to be able to see whether visitors from a particular source click on multiple deals. i.e. enters from the source and then clicks on 3 different deals that take the user to other sites. Using GA, can I track this by implementing UTM on both the campaign links and outgoing links? Can I see exactly how many deals the average user is clicking on? As far as I know I can: Track visitors from the campaign Track overall clicks on deals Divide click outs by visitors But I can't track how many deals the visitors from campaign A clicked on... or can I?
Conversion Rate Optimization | | Red_Mud_Rookie0