Google Shopping Feed being blocked by robots.txt
-
I had created a manual Google Shopping Feed that was working fine, and then someone well meaning put a block in my robots.txt file so Google couldn't read the images folder. because of this, Google now won't accept my feed.
I changed the robots.txt file to allow them to read the images again, but it's been 3 days now and I'm still getting the error saying my products are disallowed because the robots.txt file won't let them scan for images.
Does anyone know how long it will take for Google to see it again?
-
When I manually fetch, the /images folder isn't on the list anymore.
For now I have just reuploaded the images in to a new folder and I'm creating my feed by hand, so that should get around it for now.
Thanks for your help.
-
Did you try manually fetching as Googlebot the robots.txt file via the webmaster tools? If not, do that, then click submit to index. Then do the same thing for some of the images or better if you have a file linking to all images (like an image sitemap). Once that is done, let Google recrawl everything for a few days (even a week) and try again.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How Google Search works
I watched this video over the weekend. If you haven't yet, this is a great documentary every SEO client should watch. watch?v=tFq6Q_muwG0
Paid Search Marketing | | WebDaytona0 -
Can Google Shopping Ads Lower Ranking due to Bounce?
I am noticing Google Shopping Ads are showing up for really irrelevant keywords on some of my products. This quite predictably causes a high bounce rate when a user comes from these ads. There is very little control over what Google Ads seems to decide are relevant keywords from what I can see. Only control is by viewing search terms and setting as negative keywords, but his doesn't help much. Negative keywords are often ignored or they come up with some other really irrelevant new keyword. Seems this high bounce rate could hurt ranking? Any experiences shared with Google Shopping ads appreciated!
Paid Search Marketing | | Chris6611 -
How to track in Google Analytics 2 different subdomains (one for website, the other for PPC landing pages)
Hello Mozers! I have a website with organic visits/goals on www.site.com and a few AdWords Campaign landing pages on lp.site.com whose goals are tracked with both adwords conversion monitoring AND analytics (not imported from analytics into Adword). The landing pages of the campaign have nothing to do with the web site (different cms, they don't link each other, totally isolated) and viceversa. Given that, what would it be the best practice to configure Google Analytics to track the website (www.site.com) AND a PPC campagin (lp.site.com)? I have been told to set up different views of the same property, but do I really need that? Please let me know what are you thinking. Thank you very much. DoMiSoL Rossini
Paid Search Marketing | | DoMiSoL0 -
Two google analytics accounts on one site.
I've got a client who is using a third party for cpc ads, to track these we need to give the third party admin access to google analytics. Being that we are seeing massive discrepancies in reported cpc ads and refunds etc.. have been offered, I can't trust that as an admin they won't delete the profile with all data proving reason for refund. Can we create a second google analytics account (not profile) to protect the data? We want to give access to sensis to the new account so we can start seeing the cpc separation in traffic source from now while ensuring the existing account can't disappear.
Paid Search Marketing | | salemtas0 -
Google Adwords Conversion Tracking - Recording Wrong Page
Hi Guys I have a problem with my Google Adwords conversion tracking. Basically whenever I check to see which page it is recording, it shows me the incorrect one. Now I probably checked a thousand time now and the conversion tracking code is not on this specific page, but is on the one that I really want to track. I have also checked that the code is correct and that there is nothing missing. But strangely enough when I look at historical data, it does show that is was tracking conversions on the correct page, but for some reason the past couple of weeks it's reporting conversions from another page, which is the incorrect one. If somebody could please give me some insight as to what could maybe be the cause of this, I would appreciate it. Thank You Dave
Paid Search Marketing | | DavidZA10 -
Facebook PPC. Using Google URL Builder - Now What?
Hey There! So I've been trying some FB PPC ads. I recently learned I needed to use Google's URL builder to add the appropriate tracking fields into the URL (source, campaign, etc). The FB ad link now uses a custom URL with all the correct parameters. Now what do I do in analytics? Do I create a filter? A goal? Getting a little dizzy going in circles with google analytic help, and I'm hoping someone here can direct me. Thanks! -Dan
Paid Search Marketing | | evolvingSEO0 -
Your Google AdWords account has been permanently suspended for repeated violation of AdWords or Landing Page and Site policies in this or a related account.
My client nor I received any warning. We even had a google adwords team optimize the account and my rep does not yet know the reason for the ban. Not sure if its related but their google organic rankings dropped significantly at the same time. https://adwords.google.com/support/aw/bin/answer.py?hl=en&answer=164786 Any advice here? Do these Questions get indexed by google? I will ask my client if I can disclose the domain. Is there any way around a permanent ban? They were spending 50K per month. Is this enough to have any clout?
Paid Search Marketing | | webbroi0 -
Paid Comparison Shopping Engines
I am looking into starting to use the comparison shopping engines. Any ideas on where to start wtih this? Is there a good place to go that would manage all the different sites?
Paid Search Marketing | | Shopadorn0