Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Google Shopping Feed being blocked by robots.txt
-
I had created a manual Google Shopping Feed that was working fine, and then someone well meaning put a block in my robots.txt file so Google couldn't read the images folder. because of this, Google now won't accept my feed.
I changed the robots.txt file to allow them to read the images again, but it's been 3 days now and I'm still getting the error saying my products are disallowed because the robots.txt file won't let them scan for images.
Does anyone know how long it will take for Google to see it again?
-
When I manually fetch, the /images folder isn't on the list anymore.
For now I have just reuploaded the images in to a new folder and I'm creating my feed by hand, so that should get around it for now.
Thanks for your help.
-
Did you try manually fetching as Googlebot the robots.txt file via the webmaster tools? If not, do that, then click submit to index. Then do the same thing for some of the images or better if you have a file linking to all images (like an image sitemap). Once that is done, let Google recrawl everything for a few days (even a week) and try again.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Google Ads Subdomain in sitelinks & Composition Change for Strategy Status
I have a basic query but could not find a definite answer on the internet. I am currently running a campaign for the main website of a big education brand and they also have a secondary learning website on subdomain, and I want to add sitelinks of subdomain to the campaign, but I am not sure whether it is allowed or not. The brand I am running ads for is https://www.rauias.com/ and the secondary website is https://compass.rauias.com/ branded slightly different in a subdomain, so should I add the sitelinks of Compass to the main campaign? Also one more silly question My Max Conversion search campaign gave me this status today. "Learning (composition change): Campaigns have been added to or removed from the bid strategy. Google Ads is now adjusting to optimize bids. 5 days left for learning" What does this mean exactly? And Why does it reenter the learning phase whenever I make a small change?
Paid Search Marketing | | rauoff0 -
Unsolved How should I update the grouping of keywords in a google ads account
hi, I have a google adwords account running for a while in a fairly competitive market in a major city so there is only one geo location with many suburbs or council areas as popular searched. I have keywords that are 2-4 words long and very similar. I have had one keyword in its own campaign, several in one campaign and a location campaign. The location campaign has several adgroups for specific suburbs. My question is that the most popular search terms are similar but in different campaigns and I am wondering if this is not the best way. for example I have these keywords in separate campaigns as exact match and phrase match
Paid Search Marketing | | salliWW
rubbish removal
rubbish removal near me
rubbish removal Washington But the way google uses exact match seems to be changing and I am concerned these would be best in one adgroup. Also these keywords trigger similar phrases, for example, waste removal. Is it best to put them in one campaign with one ad group or one campaign with separate adgroups, or leave as is. As competition has increased I need to bid for top of page now and need to keep budget rises as little as possible..0 -
Clients Keep Googling Themselves
Hi, I have a common problem with my clients where they google their own business name or keywords they want to rank for and freak out when they don't show up on the first page of results. The same is true for my paid search clients. Is there a good way I can explain to them how Googleing themselves is not the best way to know if they are performing well? If there is an article out there that explains it that I can share that would be even better.
Paid Search Marketing | | GuardianOwlDigital0 -
Google Analytics showing my Adwords campaign bounce rate at 0%
I am relatively new to Adwords, and I can't figure out why the Adwords section of Analytics is showing all my site visitors at 0% bounce rate. Does that mean the account connection is not done right? Obviously Google ads are not a 0% bounce rate. If I can't get that to work, does anyone know how Google ads appear in Traffic? Is it Direct or Referral? I'm sure there's some simple answer I'm just not aware of, I would appreciate anyone's help. Thanks!
Paid Search Marketing | | Crystalline_150 -
Google URL Builder / Campaign Tracking on two Different Domain using the Same Analytics Code
Hey Everyone, I think I know the answer to this but I'd like to get some confirmation. I currently have a landing page at "www.xyz.com", it's a separate domain in which only the landing page exists and not a vanity URL which redirects. However, the navigation and all the links on "www.xyz.com" actually link out to "www.abc.com". The domain / landing page "xyz" has the same analytics tracking code as domain "www.abc.com". My question is this, if I use Google URL builder to create custom URL's to track for each ad that I'm running in Adwords, will this data show up in the analytics of "abc" even though it's a separate domain because it has the same analytics code? In other words, does campaign data show only if the domain and the google analytics code line up, or does the domain not matter and as long as you have the same analytics code (despite two separate domains) that campaign data (built through Google URL builder) will show? My hunch and best guess it that as long as the analytics code is the same (regardless of a separate domain) that the data in campaign will show with the custom URL's I build. I'm aware that I can test this and I will but I'd like to get an idea from the community first to make things easier. Anybody have experience with this? Answers greatly appreciated! Thanks!
Paid Search Marketing | | EvansHunt0 -
Best practice to separate paid from organic conversions in Google Analytics
I have a PPC campaign for a client with standalone landing pages with a form, not reachable from the website (although in the same domain). I've added the AdWords conversion code to the "thank you" page and I also added a Goal in
Paid Search Marketing | | DoMiSoL
Google Analytics whose counter is increased every time the thank you page is reached. This way I can track conversions with both AdWords and Analytics. Is that correct? Should I import back in AdWords the goals from Analytics, as suggested in the AdWords account? I have another landing page with a form in the website, where I send users coming from
organic search, so I set up a second goal in Analytics for the thank you page of this form. Is this the reason why I am supposed to import in AdWords the analytics' goals, so that I could see both kind of conversions in both accounts? But the most important question is: If I send both PPC/organic visitors to the same landing page is there still a way to separate PPC from Organic conversions? Thank you very much for your advice. DoMiSoL Rossini0 -
Google Analytics and WorldPay - Tracking Sales/Conversions
Hi there, I recently remember reading somewhere that tracking code could be used to monitor sales/conversions of eCommerce payments that went through WorldPay. I've been looking around the web for news stories, forums, discussions, but all seem to be from 2007 - 2011; was just wondering if anyone knew any up-to-date info they could point me towards? Thanks
Paid Search Marketing | | bricktech0 -
Increasing Google Ad spend - is it worth it
Hi We are currently spending approx £500 pcm on google ad words however if I increased this spend to £4000 pcm what kind of results would this achieve? For example would it just be more visits per day as the budget is larger? Also what is the best way to track the success of an adwords campaign - the ultimate goal of the campaign would be to generate a lead whether this be a phone call, email or using our book an appointment form. Our service covers a geographical area (Scotland) and for organic search we are doing well 1st pages listings for searches such as pvc doors edinburgh etc so I am unsure whether it's worth increasing my PPC spend or put more resource into SEO, or even Facebook ads?
Paid Search Marketing | | ocelot0