Issue with a particular command of robots.txt! Help needed!
-
Hi all,I'm facing a strange issue with a website: www.foodmood.itI've written this robots.txt: www.foodmood.it/robots.txt in which I'm using all commands I've tested and used on other websites.The problem is that this website is not indexing correctly, and my fear is that I've written the robots in a wrong way.In this forum I've been taught that this command Disallow: /*? should be substituted with Disallow: /? in order to be sure the crawler is not indexing all the URLs containing a question mark.My question is: do you think this command modified in the above way can cause a problem to my website?I repeat that I've used it on several sites and this is the first time I'm having this kind of problems.Thanks in advance for your help.A.
-
I would in future tend to trust sources closer to being official rather than someone on a forum. Remove the extra * so its just Disallow: /*?
You can find more info here - https://support.google.com/webmasters/answer/156449
You can also test your robots in your webmaster tools so don't forget to give that a go if in doubt.
Hope that helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What kind of home page need to be, to show good results of SEO?
Hello, i have couple questions about new home page building. I want to start build new home page to replace old one. At this moment my home page is obsolete and shows low conversion. My costumers often have negative thoughts about existing one. My knowledges in coding is weak, where should i pay more attention to design, to section placement, to pictures and video gallery? Can hosting positively or negatively affect to SEO results? How to make the new website load faster? Here's my website's example. http://www.skydas.lv http://www.m-lux.lv http://www.sosdienests.lv Thank you very much, waiting for replay.
Conversion Rate Optimization | | Felter0 -
IE & Edge issues with site relaunch - advice appreciated
Hi, I've been involved in a major ecommerce site relaunch, redesign and backend and have been involved in several successful ones before. On the whole things have gone great. Of course there are some minor bugs to fix, rendering issues etc but my real concern is a significant decline in conversion rate BUT only for IE and Edge users. All other major browsers conv rate has increased. Trawling through analytics and the site itself in those browsers there is no obvious sticking points e.g bounce rate has improved on all browser inc IE & Edge, no particular point in the funnel is suffering more than others, no particular page or landing page is doing much worse than others etc. it just seems like all the kpi's (except bounce) are down a little on the 2 microsoft browsers, which has a significant impact. One of the things that changed on relaunch is that we moved to https and im wondering if that might be causing an issue with IE / Edge security or privacy settings or that functionality on the site that relies on cookies is being affected, though in testing we haven't come across anything. I'd appreciate any advice or insight. Thanks, Andy
Conversion Rate Optimization | | AndyMacLean0 -
Will hreflang indication help single language site?
I have read a few articles that say indicating a language per webpage with hreflang really only helps sites that use multiple languages. Although my site is only in English, I see that it is ranking for a few foreign language keywords in Google Search Console (not sure exact traffic but roughly 15% of visitors from Search are non English preferred). My thought is that indicating language will help my single-language site because it will weed out the non-english speakers who are probably bouncing from the site. Overall I am thinking it might improve the quality of my search traffic. Do you think my logic is sound, or is adding hreflang not beneficial to my site? All feedback welcomed. Thanks!
Conversion Rate Optimization | | Jonathan.Smith0 -
Google Experiments issues
Hey fellow Mozzers! We're in the middle of working on CRO for a client of ours and we were going to try out Google Experiments for the first time. Following the click path described on the Google help page should take me to an option that says 'Create Experiment', but this isn't coming up - do we need to create the various URLs before it will let us set up an experiment, or has the system changed now? I've found in the past Google has a habit of updating its interfaces but not the advice on using the affected tools, so wondering if I'm looking at old information? Secondly, does the Experiment show a user the same variation of the page throughout their journey? What I mean by that is: their site currently has a real mish-mash of page styles, and I think a large part of boosting their conversions is probably down to ensuring consistency across the site as it currently seems like you're bouncing around different sites. But will this issue be made worse by running Experiments - ie, will I enter the site on Variation A, click a link and be shown the next page in Variation B and so on? If so, are we better off running the experiment on one page at a time and using what we've learnt to impact the next page? Thank for any help you can give! Nick.
Conversion Rate Optimization | | themegroup1 -
Google Remarketing Conversions - Possible Issue
Hi All, When it comes to Google Adwords, when considering conversions, Google assigns each conversion back to the click that originally drove that visitor on the day they clicked. so, even if someone converts today, Google would show that conversion as occurring two weeks ago when the visitor originally clicked on a paid search ad and came to my site. fine...whatever. My question now is if we use a remarketing campaign through the Display Network, and someone converts, will that conversion be shown under their new visit or back on their original click where they did not originally convert, causing them to be included in our remarketing audience? Cant seem to find a straight answer anywhere and hoping someone out there has some guidance.
Conversion Rate Optimization | | dsinger0 -
Help Me Improve this Page, Please
Time for the weekly "help me improve this page" post 🙂 I'd appreciate it if you all would take a look at this page and give me some tips to improve it from a user - point - of - view. The URL is http://goo.gl/9mcyF My main goal is conversions and I'm trying to make this page as good and helpful and easy as possible for potential buyers and visitors. I'd appreciate any tips or suggestions that you think may help. Thanks!
Conversion Rate Optimization | | Prime851 -
I am trying to make my site a better user experience please help
Hi, i want someone to review my site and let me know what steps i need to do to make it a better experience for the user and to lower my bounce rate which is about 67 at the moment. I am trying to get the advertising and the user friendly to match, i need the adverts to make money and need to make sure i have them in the right place so they get clicked more. I want to reduce my bounce rate and want people to not just read one page but to go to different pages and would like advice on what i need to do. here is the site http://www.in2town.co.uk and here are the example pages that i would like to focus on to increase the user friendly and keep people on my site while making sure i have the adverts in the right place http://www.in2town.co.uk/news/gossip-celebrity/alex-reid-says-he-is-fed-up-with-chantelle-houghton-lies http://in2town.co.uk/news/travel-holiday-news/sainsburys-customers-10-points-back-on-easyjet-flights-with-nectar http://in2town.co.uk/news/small-business-news/how-emerging-technology-can-help-reduce-small-business-costs I am looking for ideas on how to increase the experience and how to keep people longer on my site while at the same time have people clicking the ads by increasing the conversion rate.
Conversion Rate Optimization | | ClaireH-1848860 -
Need advice on google adsense positioning
Hi my site www.in2town.co.uk gets a few thousand visitors a day but i am having trouble making any money from google adsense and this is because i am no good at advertising or understand it. I have tried many formats and i just cannot understand the correct way to do it and would really like some help and advice in what i am doing wrong. Would really love to see some magazines that do google adsense to see where i am going wrong. Here is one page from my site with google adsense http://www.in2town.co.uk/news/health-women/nearly-one-in-four-women-risk-skin-cancer-by-not-wearing-sun-tan-lotion and here is another example http://www.in2town.co.uk/latest-business-news/business-expert-says-franchise-opportunities-are-a-great-way-to-start-a-business If anyone can please help me understand what i am doing wrong please, then that would be great.
Conversion Rate Optimization | | ClaireH-1848860