Google Giving 404 Errors to Working Pages
-
We have a problem that just came up out of the blue with Google, in particular Webmaster Tools & our Merchant Center. We're getting a 404 errors for 1000s of pages in both of these applications, but the pages are working just fine. Our shopping campaigns have been hit hard as many of our top products have been suspended from our merchant feed. Webmaster tools is giving us 1000s of 404 errors to product & category pages alike. But every page returning a 404 error is working. We've contacted Google and they mention that they are not getting a 404 error, but their crawler seems to be. Has anyone ever experienced this? What could be causing this?
Thanks for any input.
-
Hi Paul, what is the status of this issue? Has it been resolved, or not? Would love an update! Thanks ~ Christy
-
Yes, attackers use code injection techniques to hijack search results. They in fact do use some randomization techniques to make it harder to detect. Conducting a security scan using a tool like Sucuri.net could be helpful but manually reviewing your .htaccess and code may be necessary.
-
Thanks jeff-rackaid.com.
The idea of some sort of fowl play did cross our minds. These errors seemed to appear out of the blue without any significant code changes on our side.
We have done a fetch as Googlebot on a number of pages. We had found that the returns have been inconsistent; we would fetch a particular page and get a "Not found" error one minute and then a "complete" result the next minute. I don't think this is a normal activity.
We've also been tracking the traffic of Googlebot to our site and since Thursday (8/14), the hits from GoogleBot have been going down while the hits from an "unknown bot" have been increasing.
-
This could just be a WMT error. I've seen this from time to time. If it persists for more than 24 hours, then you may want to try digging into it further.
Have you tried fetching as Googlebot
In doing server security work, I have seen some hijacking attempts that will send 301 responses to Googlebot. In some cases, these scripts are improperly deployed resulting in 404 errors or 500 errors. So I would first fetch the site as Googlebot.
Then examine your server's access logs for hits from Googlebot. Confirm that it is indeed Googlebot. You can verify Googlebot IP ranges with reverse DNS:
https://support.google.com/webmasters/answer/80553?hl=en
If there's no foul play, then check for any browser-based detections routines. With the increasing use of mobile, I have seen some code fail to handle bots correctly. The behavior is usually an error not a 404. However, many CMS systemincorrectly send 404 errors for a variety of errors and not just true not found status codes.
-
On Aug 16th i got a similar error mydomain.com/page/feed/ is all giving 404 errors I look at the xml and it shows an xml with title tags it has the site name - page not found. but the feed pages is not index in google.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Google Ads Subdomain in sitelinks & Composition Change for Strategy Status
I have a basic query but could not find a definite answer on the internet. I am currently running a campaign for the main website of a big education brand and they also have a secondary learning website on subdomain, and I want to add sitelinks of subdomain to the campaign, but I am not sure whether it is allowed or not. The brand I am running ads for is https://www.rauias.com/ and the secondary website is https://compass.rauias.com/ branded slightly different in a subdomain, so should I add the sitelinks of Compass to the main campaign? Also one more silly question My Max Conversion search campaign gave me this status today. "Learning (composition change): Campaigns have been added to or removed from the bid strategy. Google Ads is now adjusting to optimize bids. 5 days left for learning" What does this mean exactly? And Why does it reenter the learning phase whenever I make a small change?
Paid Search Marketing | | rauoff0 -
Looking at google shopping results from other country
Hi, I run shops in several languages out of London. One of our key revenue drivers is google shopping. It is important for me to look the the shopping search results for example in germany. Recently Google changed something so when I want to look at the german shopping results from here, eg. http://www.google.de/shopping it always shows me the english ones with prices in pounds. Is there a trick to still get the foreign results? Thanks in advance Dieter
Paid Search Marketing | | Storesco1 -
Paid Search Visits Not Showing Up in Google Analytics
Hey all, Just took over SEM for my company, and noticed a bit of a problem with GA. Whereas Adwords has registered 141 clicks on paid campaigns that go to the site, GA has tracked only 5 vists in that time. Two things of note: The GA account was not linked to the Adwords account until today, and also, auto-tagging was not turned on. I understand these two things are important to having proper GA tracking, but I just want to make sure that there aren't any other things I should check right now to make sure I start to see tracked paid visits again. Is there anything else I should try? Cheers.
Paid Search Marketing | | danny.wood0 -
Index or Noindex PPC Landing Pages?
Hi all, We have thousands of PPC landing pages for our products. Usually, these pages are very similar and may differ only slightly for the keyword in question. The landing pages are sitting in a sub-domain of our site. From SEO perspective, assuming we don't want to get hit by Panda, Penguin and other animals Google stuffed into its ranking algorithm...Is it a good idea not to index these landing pages at all (i.e. add meta robots - noindex, nofollow to these pages)? What say you? Thanks!
Paid Search Marketing | | ShivaS0 -
Tool for Google AdSense - Earning Money
Hello folks, I want to know which market gives the best CPC in my country. For example: hotels, food, gastronomy, software, and so on... Is there any tool to do such a kind of thing? Do you guys have any experience which kind of market gives a interesting revenue? Thanks.
Paid Search Marketing | | augustos0 -
In Google Adwords, can I create negative dollar-amount keywords?
example of negative keywords: -$40 driving lessons -35 dollar driving lessons The driving lessons I'm selling are $55 an hour, so I obviously don't want unqualified leads chewing through my budget when they clearly don't want to spend $55 on a lesson. I already have the price mentioned in my ads, but I want to negative out the dollar amounts because people are still stupid enough to click without reading the ad. Any help will be appreciated! Matt
Paid Search Marketing | | strilliams0 -
Google Ads not showing
Hello, I am having some trouble with my google adwords. I decided to split my existing campaign into two campaigns, one for customers in the UK and one for the rest of the world. The keywords are the same - only the message is different. i.e. Tractor Parts Free UK shipping on Tractor parts mysite.com/tractor-parts & Tractor Parts Fast shipping to Europe from the UK mysite.com/Tractor-Parts According to Google Adwords my UK campaign has had no impressions and no clicks. However if I search for one of the keywords it appears in the search results with the UK text. Anyone got any ideas?
Paid Search Marketing | | DavidLenehan0