Google Giving 404 Errors to Working Pages
-
We have a problem that just came up out of the blue with Google, in particular Webmaster Tools & our Merchant Center. We're getting a 404 errors for 1000s of pages in both of these applications, but the pages are working just fine. Our shopping campaigns have been hit hard as many of our top products have been suspended from our merchant feed. Webmaster tools is giving us 1000s of 404 errors to product & category pages alike. But every page returning a 404 error is working. We've contacted Google and they mention that they are not getting a 404 error, but their crawler seems to be. Has anyone ever experienced this? What could be causing this?
Thanks for any input.
-
Hi Paul, what is the status of this issue? Has it been resolved, or not? Would love an update! Thanks ~ Christy
-
Yes, attackers use code injection techniques to hijack search results. They in fact do use some randomization techniques to make it harder to detect. Conducting a security scan using a tool like Sucuri.net could be helpful but manually reviewing your .htaccess and code may be necessary.
-
Thanks jeff-rackaid.com.
The idea of some sort of fowl play did cross our minds. These errors seemed to appear out of the blue without any significant code changes on our side.
We have done a fetch as Googlebot on a number of pages. We had found that the returns have been inconsistent; we would fetch a particular page and get a "Not found" error one minute and then a "complete" result the next minute. I don't think this is a normal activity.
We've also been tracking the traffic of Googlebot to our site and since Thursday (8/14), the hits from GoogleBot have been going down while the hits from an "unknown bot" have been increasing.
-
This could just be a WMT error. I've seen this from time to time. If it persists for more than 24 hours, then you may want to try digging into it further.
Have you tried fetching as Googlebot
In doing server security work, I have seen some hijacking attempts that will send 301 responses to Googlebot. In some cases, these scripts are improperly deployed resulting in 404 errors or 500 errors. So I would first fetch the site as Googlebot.
Then examine your server's access logs for hits from Googlebot. Confirm that it is indeed Googlebot. You can verify Googlebot IP ranges with reverse DNS:
https://support.google.com/webmasters/answer/80553?hl=en
If there's no foul play, then check for any browser-based detections routines. With the increasing use of mobile, I have seen some code fail to handle bots correctly. The behavior is usually an error not a 404. However, many CMS systemincorrectly send 404 errors for a variety of errors and not just true not found status codes.
-
On Aug 16th i got a similar error mydomain.com/page/feed/ is all giving 404 errors I look at the xml and it shows an xml with title tags it has the site name - page not found. but the feed pages is not index in google.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Google Ads - Subdomain on Sitelinks & Composition Change for Strategy Status
I have a basic query but could not find a definite answer on the internet. I am currently running a campaign for the main website of a big education brand and they also have a secondary learning website on subdomain, and I want to add sitelinks of subdomain to the campaign, but I am not sure whether it is allowed or not. The brand I am running ads for is https://www.rauias.com/ and the secondary website is https://compass.rauias.com/ branded slightly different in a subdomain, so should I add the sitelinks of Compass to the main campaign? Also one more silly question My Max Conversion search campaign gave me this status today. "Learning (composition change): Campaigns have been added to or removed from the bid strategy. Google Ads is now adjusting to optimize bids. 5 days left for learning" What does this mean exactly? And Why does it reenter the learning phase whenever I make a small change?
Paid Search Marketing | | rauoff0 -
Any data for Google results page click through rates?
Hi. Trying to find data for click through rate for the Google search results page? If I run Adwords, do I want a PLA listing or a text listing? Or do I work on PLA + Organic or Text + Organic? What percentages do each position get approximately? E-commerce website. Technology sector. Any help?
Paid Search Marketing | | YNWA0 -
Will Google penalize a text ad if the display URL goes nowhere?
Today I had a colleague ask me if Google Adwords will penalize text ads that have display URLs that land on 404 pages. I fully understand the policy that the domains in display URLs and destination URLs have to match up or Google will disapprove the text ad. However if the display url contains the proper domain (and a target keyword phrase for a file folder) will Google penalize the text ad quality score if the display URL lands on a 404? I had trouble finding specific evidence for this.
Paid Search Marketing | | VanguardCommunications0 -
Is High PageRank Quality Related But Paid Directory Listing Still Work?
Hi, We are a local cleaning company in Singapore specialising in all types of home and office cleaning service. My question is after the Google Penguin, does high PR but paid directory still working?
Paid Search Marketing | | chanel27
Or it will be considered a toxic links. It is getting harder to do backlinking now so we really need to be very careful here.0 -
Facebook ads to people who like a particular brand or page
Can I target my facebook adds to only those users who like a brand or page? I have an exhibition coming up next year and would like to target those who like the brand page. I know I can target on interests etc but cannot see how I can target a particular page. Any advice greatly appreciated as I am sure others would be interested if this can be done. ThanksJames
Paid Search Marketing | | tempowebdesign0 -
PPC Landing Pages and Rel Canonical
Hi Mozzers! Our company has hundreds of PPC landing pages which are essentially request a quote forms. We also have a request a quote form on our website that is for regular traffic. Currently we just added the "noindex" meta tag to all our PPC landing pages, but I think we can improve this. Should we remove the "noindex" tag, and instead add a rel canonical link pointing to our "main" request a quote form? Thoughts?
Paid Search Marketing | | Travis-W0 -
Google Adwords Conversion Tracking - Recording Wrong Page
Hi Guys I have a problem with my Google Adwords conversion tracking. Basically whenever I check to see which page it is recording, it shows me the incorrect one. Now I probably checked a thousand time now and the conversion tracking code is not on this specific page, but is on the one that I really want to track. I have also checked that the code is correct and that there is nothing missing. But strangely enough when I look at historical data, it does show that is was tracking conversions on the correct page, but for some reason the past couple of weeks it's reporting conversions from another page, which is the incorrect one. If somebody could please give me some insight as to what could maybe be the cause of this, I would appreciate it. Thank You Dave
Paid Search Marketing | | DavidZA10 -
Google Adwords Book
Does anyone have a suggestion on a very recent Google Adwords book?
Paid Search Marketing | | phogan0