Google Shopping Feed being blocked by robots.txt
-
I had created a manual Google Shopping Feed that was working fine, and then someone well meaning put a block in my robots.txt file so Google couldn't read the images folder. because of this, Google now won't accept my feed.
I changed the robots.txt file to allow them to read the images again, but it's been 3 days now and I'm still getting the error saying my products are disallowed because the robots.txt file won't let them scan for images.
Does anyone know how long it will take for Google to see it again?
-
When I manually fetch, the /images folder isn't on the list anymore.
For now I have just reuploaded the images in to a new folder and I'm creating my feed by hand, so that should get around it for now.
Thanks for your help.
-
Did you try manually fetching as Googlebot the robots.txt file via the webmaster tools? If not, do that, then click submit to index. Then do the same thing for some of the images or better if you have a file linking to all images (like an image sitemap). Once that is done, let Google recrawl everything for a few days (even a week) and try again.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Googleweblight Traffic in Google Analytics
Google analytics showing Googleweblight traffic is paid traffic or organic traffic or anything else? If any post related to this query, kindly send that URL.
Paid Search Marketing | | vivekrathore0 -
Will Google penalize a text ad if the display URL goes nowhere?
Today I had a colleague ask me if Google Adwords will penalize text ads that have display URLs that land on 404 pages. I fully understand the policy that the domains in display URLs and destination URLs have to match up or Google will disapprove the text ad. However if the display url contains the proper domain (and a target keyword phrase for a file folder) will Google penalize the text ad quality score if the display URL lands on a 404? I had trouble finding specific evidence for this.
Paid Search Marketing | | VanguardCommunications0 -
Best practice to separate paid from organic conversions in Google Analytics
I have a PPC campaign for a client with standalone landing pages with a form, not reachable from the website (although in the same domain). I've added the AdWords conversion code to the "thank you" page and I also added a Goal in
Paid Search Marketing | | DoMiSoL
Google Analytics whose counter is increased every time the thank you page is reached. This way I can track conversions with both AdWords and Analytics. Is that correct? Should I import back in AdWords the goals from Analytics, as suggested in the AdWords account? I have another landing page with a form in the website, where I send users coming from
organic search, so I set up a second goal in Analytics for the thank you page of this form. Is this the reason why I am supposed to import in AdWords the analytics' goals, so that I could see both kind of conversions in both accounts? But the most important question is: If I send both PPC/organic visitors to the same landing page is there still a way to separate PPC from Organic conversions? Thank you very much for your advice. DoMiSoL Rossini0 -
A question for Google Adwords experts
Hi Google Adwords experts, We own the trademarks to some keywords. When you search for these keywords, only our ads will ever appear but they don't appear every time a search is made. They're hardly ever appearing now that we've dropped our bid from $1+ to the minimum first page bid (1 cent in some cases). My question is; are the ads showing less because our bid has dropped so low? If so, why is this? If we own the trademark to the keyword and no one else can display ads, any bid that we submit should be accepted by Google, shouldn't it? If you can include a link to any articles that will give me more info, i'll vote for your answer. Thanks!
Paid Search Marketing | | HamiltonIsland0 -
Google PPC Quality Score (adventures in)
We have one keyword that brings our site the most visitors. This keyword is the brand name we carry. We have several years of tracking it in Adwords. For some extended time, this keyword [exact match] has averaged 19 cents per click, 2.7 average position, 4.5% click through, and a quality score of 7/10. We wanted more clicks. We could think of what was needed to increase the quality score. Sure, we could change the meta tag title and the adwords title to be the same as the single word keyword, but this would be less informative. We decided to keep these titles as phrases which include the brand name. First change we made: we increased the bid. After all, it was profitable for the two ads above us, right? We increased our bid from .50 to $1.50. Effect? Average position increased to 2.3 from 2.7. Click through increased from 4.5% to 4.9%. Cost per click went from .19 to .51. The incremental cost for each sale was......well really really high.....this didn't work. (oh, we rank #2 organically. Our organic CTR dropped from 3.2% to 2.9% with this change as well) Reversed back to where we were and decided to focus on the quality score. We realized that the keyword was part of an add group with about 20 other keywords. This word was important.....lets put it in it's own ad group. We then made an "exact" copy of the ad and started up a new ad group. Paused the old keyword. We very quickly realized that the quality score on this "same" keyword was now 4/10. That was odd....lets give it a few days......quality score drops to 3/10 and no longer qualifies for first page. What was different we wondered? AH! We capitalized the first letter of the word. Changing this took the quality score up to 6/10 instantly. hmmm, we thought capitalization didn't matter? Seems it did. We now wait to see where the quality score goes. Saga to continue....
Paid Search Marketing | | EugeneF0 -
Doing Google Places for customer - best solution?
I work at a media agency in Denmark and I'm trying to open a Google Places-account for one of our retail-customers which is to be linked to the customers AdWords-account. I created a Places account and via bulk upload I submitted the customers 74 locations. I was then asked to verify my bulk upload, which I did. That's two weeks ago, and I've tried to get help from our Google contact but to little avail. Could the problem be that I am doing the places account on behalf of our customer, and thus when I am asked to verify the upload I supply my own information (contact phone and business name) rather than the customers? Have any of you had a similar experience? Is there an alternate path I can take to solve this?
Paid Search Marketing | | Iumreprise0 -
Google Adwords Book
Does anyone have a suggestion on a very recent Google Adwords book?
Paid Search Marketing | | phogan0 -
Paid Comparison Shopping Engines
I am looking into starting to use the comparison shopping engines. Any ideas on where to start wtih this? Is there a good place to go that would manage all the different sites?
Paid Search Marketing | | Shopadorn0