Google Giving 404 Errors to Working Pages
-
We have a problem that just came up out of the blue with Google, in particular Webmaster Tools & our Merchant Center. We're getting a 404 errors for 1000s of pages in both of these applications, but the pages are working just fine. Our shopping campaigns have been hit hard as many of our top products have been suspended from our merchant feed. Webmaster tools is giving us 1000s of 404 errors to product & category pages alike. But every page returning a 404 error is working. We've contacted Google and they mention that they are not getting a 404 error, but their crawler seems to be. Has anyone ever experienced this? What could be causing this?
Thanks for any input.
-
Hi Paul, what is the status of this issue? Has it been resolved, or not? Would love an update! Thanks ~ Christy
-
Yes, attackers use code injection techniques to hijack search results. They in fact do use some randomization techniques to make it harder to detect. Conducting a security scan using a tool like Sucuri.net could be helpful but manually reviewing your .htaccess and code may be necessary.
-
Thanks jeff-rackaid.com.
The idea of some sort of fowl play did cross our minds. These errors seemed to appear out of the blue without any significant code changes on our side.
We have done a fetch as Googlebot on a number of pages. We had found that the returns have been inconsistent; we would fetch a particular page and get a "Not found" error one minute and then a "complete" result the next minute. I don't think this is a normal activity.
We've also been tracking the traffic of Googlebot to our site and since Thursday (8/14), the hits from GoogleBot have been going down while the hits from an "unknown bot" have been increasing.
-
This could just be a WMT error. I've seen this from time to time. If it persists for more than 24 hours, then you may want to try digging into it further.
Have you tried fetching as Googlebot
In doing server security work, I have seen some hijacking attempts that will send 301 responses to Googlebot. In some cases, these scripts are improperly deployed resulting in 404 errors or 500 errors. So I would first fetch the site as Googlebot.
Then examine your server's access logs for hits from Googlebot. Confirm that it is indeed Googlebot. You can verify Googlebot IP ranges with reverse DNS:
https://support.google.com/webmasters/answer/80553?hl=en
If there's no foul play, then check for any browser-based detections routines. With the increasing use of mobile, I have seen some code fail to handle bots correctly. The behavior is usually an error not a 404. However, many CMS systemincorrectly send 404 errors for a variety of errors and not just true not found status codes.
-
On Aug 16th i got a similar error mydomain.com/page/feed/ is all giving 404 errors I look at the xml and it shows an xml with title tags it has the site name - page not found. but the feed pages is not index in google.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I've 'lost' my Google Referral Traffic
We recently re-launched our website on a new platform, PrestaShop. Up until that launch,our website, based on the DNN platform, received several thousand clicks per month from what Google Analytics classified as 'Google/referral', and several thousand more clicks collectively from international Google/referrals, i.e. Canada, Germany, UK and France. When the re-launched site went live, these clicks all went to zero on Google Analytics. My question is: Did we actually lose this Referral traffic through an improper setting on our new platform, or is this Referral simply being re-categorized in some other Source category like Organic Search?
Paid Search Marketing | | bmayer091 -
Do only paid adwords appear in google shopping
Does anyone know if we have to have a paid addwords campain for our products to appear in google shopping. We have a feed set up for google shopping. We have addwords campaigns running for google. But our products do not seem to appear in google shopping. Any advise on how to get them there?
Paid Search Marketing | | CostumeD0 -
Have you used an ad network other than Google Adwords?
We received a cold call from a company called Division-D. They make a lot of promises which sound good (but that's what marketers do 🙂 ). Advertising on a non-Google network probably would have fewer restrictions than an Adwords campaign and they say that they are fully transparent. Would it be worth it to listen to their whole pitch?
Paid Search Marketing | | Linda-Vassily0 -
How Can I Target Certain Countries in Google AdWords without Excluding Other Countries?
So, here is the situation: Our company works with merchants worldwide (with the exception of those who live in excluded high-risk countries--mostly in Africa), but most of our Google AdWords leads come from Indian merchants. My CEO wants our campaigns to convert leads from other countries (i.e., the UK, Germany, US, Canada, Australia, etc.), but I have no idea how to do that without excluding India. However, my CEO does not want to exclude India from our AdWords campaigns as the leads are profitable. We simply want more diversity with out leads in terms of geographic location. I am sure there are resources on the Web about how to do this, but I am not an Adwords expert and am unsure of what phrases to search to find the answers. Direct advice or helpful links are much appreciated. Regards,
Paid Search Marketing | | Instabill
Meghan0 -
Adding nyc to a keyword in Google Adwords
Hello. If I have a keyword in Google Adwords that is using phrase match ("keyword"), could it be useful to add the keyword phrase "keyword nyc"? Even if I did not add the second keyword phrase, my ad would be triggered if someone searched for "keyword nyc." So would it be redundant to add the second keyword phrase? Thank you!
Paid Search Marketing | | nyc-seo0 -
SIte wide links by google display / adsense
hey guys, I had a quick question about my back links that might be coming from adsense. I am trying to help my father our on his site and help him recover from penguin. unfortunately his company hired some shady SEOers to do "SEO". little did my dad know the BLs he were getting might be spammy, thats what I am checking now. When I ran a BL report on him ( i use two tools, SEO spyglass and OSE ) i found that there were many "sitewide" links, but i dont think there were placed there by the webmaster, i think they come from adsense. I know he has a PPC campaign where the daily spend is 3k/ day so I know its very possible that this might be the case. If my tool is picking up BLs from these sites ( which are niche related ) does google count these links for ranking purposes? and might this hurt my rankings if google just sees these as "sitewide links"
Paid Search Marketing | | david3050 -
Google Ads not showing
Hello, I am having some trouble with my google adwords. I decided to split my existing campaign into two campaigns, one for customers in the UK and one for the rest of the world. The keywords are the same - only the message is different. i.e. Tractor Parts Free UK shipping on Tractor parts mysite.com/tractor-parts & Tractor Parts Fast shipping to Europe from the UK mysite.com/Tractor-Parts According to Google Adwords my UK campaign has had no impressions and no clicks. However if I search for one of the keywords it appears in the search results with the UK text. Anyone got any ideas?
Paid Search Marketing | | DavidLenehan0 -
SEO for PPC landing pages
After completing several months of on-page SEO for my site (one keyphrase per URL) and getting an "A" from SEOmoz on each page, now I'm venturing into PPC AdWords for the first time. From what I've read you pretty much want one landing page per keyword/ad. So if I want to target 100 PPC keywords I need 100 landing pages. And each landing page needs to be SEO'd as if you were doing it for organic search purposes so that your ad has a chance at a high Quality Score (8 to 10). I realize that an ad's QS is 2/3rds driven by its CTR but in the beginning when the ad is new the initial QS assigned seems to be driven more by landing page relevancy and some historical attributes of the AdWords account in which the ad or Campaign is located. My question is: What, if anything, do you do different on a page designed to be a PPC landing page as compared to a regular page you would SEO for organic search benefits? Also, should you do any of the off-page things (external links with relevant anchor text) for PPC landing pages? I'm envisioning landing pages that only exist to receive PPC ad clicks and that will not be linked to from my site directly. Each landing page talks a bit about the keyword the user was searching on and then directs them to the most relevant page(s) within my site. Maybe that's flawed? Thanks for any tips...
Paid Search Marketing | | scanlin0