Google Giving 404 Errors to Working Pages
-
We have a problem that just came up out of the blue with Google, in particular Webmaster Tools & our Merchant Center. We're getting a 404 errors for 1000s of pages in both of these applications, but the pages are working just fine. Our shopping campaigns have been hit hard as many of our top products have been suspended from our merchant feed. Webmaster tools is giving us 1000s of 404 errors to product & category pages alike. But every page returning a 404 error is working. We've contacted Google and they mention that they are not getting a 404 error, but their crawler seems to be. Has anyone ever experienced this? What could be causing this?
Thanks for any input.
-
Hi Paul, what is the status of this issue? Has it been resolved, or not? Would love an update! Thanks ~ Christy
-
Yes, attackers use code injection techniques to hijack search results. They in fact do use some randomization techniques to make it harder to detect. Conducting a security scan using a tool like Sucuri.net could be helpful but manually reviewing your .htaccess and code may be necessary.
-
Thanks jeff-rackaid.com.
The idea of some sort of fowl play did cross our minds. These errors seemed to appear out of the blue without any significant code changes on our side.
We have done a fetch as Googlebot on a number of pages. We had found that the returns have been inconsistent; we would fetch a particular page and get a "Not found" error one minute and then a "complete" result the next minute. I don't think this is a normal activity.
We've also been tracking the traffic of Googlebot to our site and since Thursday (8/14), the hits from GoogleBot have been going down while the hits from an "unknown bot" have been increasing.
-
This could just be a WMT error. I've seen this from time to time. If it persists for more than 24 hours, then you may want to try digging into it further.
Have you tried fetching as Googlebot
In doing server security work, I have seen some hijacking attempts that will send 301 responses to Googlebot. In some cases, these scripts are improperly deployed resulting in 404 errors or 500 errors. So I would first fetch the site as Googlebot.
Then examine your server's access logs for hits from Googlebot. Confirm that it is indeed Googlebot. You can verify Googlebot IP ranges with reverse DNS:
https://support.google.com/webmasters/answer/80553?hl=en
If there's no foul play, then check for any browser-based detections routines. With the increasing use of mobile, I have seen some code fail to handle bots correctly. The behavior is usually an error not a 404. However, many CMS systemincorrectly send 404 errors for a variety of errors and not just true not found status codes.
-
On Aug 16th i got a similar error mydomain.com/page/feed/ is all giving 404 errors I look at the xml and it shows an xml with title tags it has the site name - page not found. but the feed pages is not index in google.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Google Ads - Subdomain on Sitelinks & Composition Change for Strategy Status
I have a basic query but could not find a definite answer on the internet. I am currently running a campaign for the main website of a big education brand and they also have a secondary learning website on subdomain, and I want to add sitelinks of subdomain to the campaign, but I am not sure whether it is allowed or not. The brand I am running ads for is https://www.rauias.com/ and the secondary website is https://compass.rauias.com/ branded slightly different in a subdomain, so should I add the sitelinks of Compass to the main campaign? Also one more silly question My Max Conversion search campaign gave me this status today. "Learning (composition change): Campaigns have been added to or removed from the bid strategy. Google Ads is now adjusting to optimize bids. 5 days left for learning" What does this mean exactly? And Why does it reenter the learning phase whenever I make a small change?
Paid Search Marketing | | rauoff0 -
Google Account verification requires phone number - too many clients!
Hello, all! I like to create a Google Account for my smaller clients, so that I can associate Analytics, AdWords, GMB, etc. all with the same account. Problem: I've used my phone number too many times, so I can't get the new account verified. I've also used all three of the other phones in our family. 🙂 I tried using the "Burner" iPhone app to create a new number, but apparently the all-knowing Google even has info on phone numbers, as it returned "This phone number cannot be used for verification." I'm sure that there's an obvious solution out there - who among you has found it, and is willing to share?! 🙂
Paid Search Marketing | | measurableROI0 -
What's the best call tracking system to use for PPC & subsequent landing pages?
Client has about 30 locations. Not planning to get too fancy (i.e. like putting JS on the page so that a dynamically generated phone is displayed to track keywords). At this point, just we only want to see if PPC is providing telephone conversions. I've used Mongoose Metrics before and it seemed good. However, I don't want to go with something simply because it's what I already know. Would love to know some of your favourites and if there are better options. Also - client is in Canada. Not sure if that makes a difference.
Paid Search Marketing | | woodsy10100 -
Hire Products on Google Shopping
Has anyone got any experience with advertising products for hire rather than for sale on Google Shopping? Is it allowed? How does it perform?
Paid Search Marketing | | ese0 -
Blocking google adwords on google.com?
Is there any chance to block google adwords (not google adsense) firefox/chrome/internet explorer 🙂
Paid Search Marketing | | FCRMediaLietuva0 -
Google Shopping Campaigns
We have noticed a noticable (typo correction) drop in Adword sales since switching to the new Google Shopping Campaigns in Google Adwords. I have just posted a comment to a Fellow Mozzer on here, as this reflects in his question too. Has anyone else noticed this?
Paid Search Marketing | | BruceA0 -
Google Display Network had 3000 new placements in May
Hi all, I'm running through traffic figures from May as there was a huge spike. This is down to a spike in Adwords, specifically the Display Network. In May 2014, there is a total of 4337 placements. In April 2014, there is a total of 1561 placements. With nearly 3000 new placements where the ad could be shown, would anybody be able to explain as to how and why this has happened? I've run through the change history, and nothing i've done explains the extra placements. Auto add placements was on, but has been on for 12 months with no more than 50 extra per month. The only change that has been done that may link is I've added a mobile phone extension on ads displayed on mobile devices? The significant extra cost has been of no benefit to the campaign, as the advert displayed on various apps, forums and irrelevant websites.Would be great if anybody could shed some light here! Thank You
Paid Search Marketing | | Whittie0 -
Yellow Stars on Google Ads.
Hi, I see some Ads on google.de with a yellow stars. I was researching how they are doing this, and just read some topics online about that. And now, i now finally that this Stars are coming from Google Product Reviews on Google Shopping. I don't sell product, i do Financial Consulting, but those ADS on germany doing the same, our product is consulting. I created an Google Merchant Account, and product feed, but i don't know which is the easiest and fastest way to active this option to review the peoples my consulting-product like this one: http://www.google.de/products/seller?zmi=finanzcheck.de&hl=de&sa=X&ei=Qg4pT5OkMY-FhQfBxdCjBQ&ved=0CCMQwQY http://www.google.de/products/seller?zmi=creditplus.de&hl=de&sa=X&ei=Qg4pT5OkMY-FhQfBxdCjBQ&ved=0CCoQwQY http://www.google.de/products/seller?zmi=norisbank.de&hl=de&sa=X&ei=Qg4pT5OkMY-FhQfBxdCjBQ&ved=0CDEQwQY Can you tell me the steps, from A-Z how to configure all this? Thanks
Paid Search Marketing | | leadsprofi0