Google Giving 404 Errors to Working Pages
-
We have a problem that just came up out of the blue with Google, in particular Webmaster Tools & our Merchant Center. We're getting a 404 errors for 1000s of pages in both of these applications, but the pages are working just fine. Our shopping campaigns have been hit hard as many of our top products have been suspended from our merchant feed. Webmaster tools is giving us 1000s of 404 errors to product & category pages alike. But every page returning a 404 error is working. We've contacted Google and they mention that they are not getting a 404 error, but their crawler seems to be. Has anyone ever experienced this? What could be causing this?
Thanks for any input.
-
Hi Paul, what is the status of this issue? Has it been resolved, or not? Would love an update! Thanks ~ Christy
-
Yes, attackers use code injection techniques to hijack search results. They in fact do use some randomization techniques to make it harder to detect. Conducting a security scan using a tool like Sucuri.net could be helpful but manually reviewing your .htaccess and code may be necessary.
-
Thanks jeff-rackaid.com.
The idea of some sort of fowl play did cross our minds. These errors seemed to appear out of the blue without any significant code changes on our side.
We have done a fetch as Googlebot on a number of pages. We had found that the returns have been inconsistent; we would fetch a particular page and get a "Not found" error one minute and then a "complete" result the next minute. I don't think this is a normal activity.
We've also been tracking the traffic of Googlebot to our site and since Thursday (8/14), the hits from GoogleBot have been going down while the hits from an "unknown bot" have been increasing.
-
This could just be a WMT error. I've seen this from time to time. If it persists for more than 24 hours, then you may want to try digging into it further.
Have you tried fetching as Googlebot
In doing server security work, I have seen some hijacking attempts that will send 301 responses to Googlebot. In some cases, these scripts are improperly deployed resulting in 404 errors or 500 errors. So I would first fetch the site as Googlebot.
Then examine your server's access logs for hits from Googlebot. Confirm that it is indeed Googlebot. You can verify Googlebot IP ranges with reverse DNS:
https://support.google.com/webmasters/answer/80553?hl=en
If there's no foul play, then check for any browser-based detections routines. With the increasing use of mobile, I have seen some code fail to handle bots correctly. The behavior is usually an error not a 404. However, many CMS systemincorrectly send 404 errors for a variety of errors and not just true not found status codes.
-
On Aug 16th i got a similar error mydomain.com/page/feed/ is all giving 404 errors I look at the xml and it shows an xml with title tags it has the site name - page not found. but the feed pages is not index in google.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Will google consider it as one click for adwords?
Hi All, Many times I want to check actual page of competitors they are targeting in google adwords. Like when I search for any keywords and my competitors page comes on top ads in google, then I copy url from search result and paste in any other browser will it be consider as click and google will charge to my competitor? Example url - https://www.googleadservices.com/pagead/aclk?------------------------------------------------------------------------&adurl= Thanks!
Paid Search Marketing | | pragnesh96390 -
What's the best call tracking system to use for PPC & subsequent landing pages?
Client has about 30 locations. Not planning to get too fancy (i.e. like putting JS on the page so that a dynamically generated phone is displayed to track keywords). At this point, just we only want to see if PPC is providing telephone conversions. I've used Mongoose Metrics before and it seemed good. However, I don't want to go with something simply because it's what I already know. Would love to know some of your favourites and if there are better options. Also - client is in Canada. Not sure if that makes a difference.
Paid Search Marketing | | woodsy10100 -
Google Analytics Offline Conversions
Hi All, I've been searching the net for this for a while now and haven't found any suitable solutions. I'm looking at a way of importing conversions into Analytics. For a business I work with there is currently a split between Contact Form Submissions (we can track) Mobile Website Calls (we can track) Offline Calls (visit the website via AdWords and pickup the phone) We currently record all call data so we can see just how many calls we are getting from the campaign, and we take notes on keywords and time of call. So manually we can figure out the conversion rate. I was wondering if there was a way to mark certain visits as conversions manually? I'm pretty sure there isn't, but figured this would be the best place to ask! Thanks in advance!
Paid Search Marketing | | gamnaking10 -
Will Google penalize a text ad if the display URL goes nowhere?
Today I had a colleague ask me if Google Adwords will penalize text ads that have display URLs that land on 404 pages. I fully understand the policy that the domains in display URLs and destination URLs have to match up or Google will disapprove the text ad. However if the display url contains the proper domain (and a target keyword phrase for a file folder) will Google penalize the text ad quality score if the display URL lands on a 404? I had trouble finding specific evidence for this.
Paid Search Marketing | | VanguardCommunications0 -
A Call From Google (Not a Question but the Moderators said to Put this Here)
This is not going to be a long post but I wanted to get something out there that a lot of other business owners might not understand. I have several different PPC campaigns that my business partner and I personally run. The campaigns are all doing quite well with a high rate of return. Never has Google contacted me (other than for surveys, which I did wind up receiving 5 blue gym bags with the Google insignia on them) and never did I think they would. The campaign they called me on wasn’t a particularly large campaign. Right now the PPC spend is around 3000/month. I understand this isn’t a little bit of money, but at the same time it’s not in the millions like most of Google’s top sites. The thing that concerned me most was the reason for their call. A nice woman introduced herself and said that the campaigns were nicely run except for a few changes. She went on to tell me of a couple of updates in the PPC realm (this happened to me yesterday – Feb 28). She said within the past few months they were rolling out a new way to target their content network and for most people they were able to save 35% (that was a number she mentioned) with the tactics she was going to suggest. My background lies in mathematics and finance (somewhat related) and I tend to know when I am either being sold or being tricked into being sold. Through the whole list of things she mentioned that would help as she was walking me through she mentioned that it was a good idea to up the bid on the content network. That way we would have more chances of being seen and it would help with out conversions. This by itself seems like decent advice, but our bid for the content network is not cheap. If they are calling every small – medium business and telling them to up their bids, we are going to have a dilemma on our hands. The dilemma being that the AdWords placement is going to cost a heck of a lot more. She said that even if we up our bid, we are not likely to pay the full amount. She wants us to have a repeat conversation on Monday. One side of me was a little upset after the conversation but all they are doing is simply up-selling. They are raising the rates through what I guess are fair business practices. A lot of business owners might just take the advice of a Google representative and not think twice about it. This means we have thousands to hundreds of thousands of people at this very moment upping the bid on their content network. If they can even get a small proportion of people to increase their bids - let's say 10% - the other 90% will start getting less shows and eventually increase their bids. Also, the people that have higher bid amounts in but aren't paying the full amount will start getting closer and closer to the amount they put in as their maximum bid. This wouldn’t be alarming to me but this is the first and only time I have ever heard from a Google representative. I can’t say I didn’t see this coming but at the same time I was definitely taken aback. I am curious to know what the MOZ community has to say.
Paid Search Marketing | | JacobEdward0 -
Google Analytics Code
I have an ecommerce website and have installed the Google Analytics Code. i am also spending the money for google adwords. i m getting clicks and as well as orders but in google analytics it show that i am getting all the traffic from organic search results whereas my daily budget get exhausted and i do get business for the keywords i bid. i want to ask is there a problem with adwords or anlytics. Or have i placed the wrong code or have placed the code not in a proper format.
Paid Search Marketing | | seosogo0 -
Which landing page is used to calculate "Landing Page Experience" of a keyword in Adwords?
In Google Adwords, one ad group can have multiple landing pages, yet keywords are shared. So when I look at the keywords, they use one of the landing pages from ads, but which one? Shall we create separate ad groups and set only one landing page per group to avoid this problem? If this is the way then how come landing page is not a shared property like the keywords in ad groups? I hope someone with enough Google Adwords experience can help me here. Thanks,
Paid Search Marketing | | fguru0 -
Isn't a product page a Landing Page?
Before starting a new ppc campaign, I am working on making my site landing pages Relevant. I see some ppc experts suggest separate, noindex, landing pages. But aren't my dynamically generated product pages landing pages- They have a call to action "add to basket" button, a big photo, and orignal detailed conent- prodct description - below all that. Sometimes I would like to advertise we have a broad selection of a Vendor's line- so then my natural landing page is a categegory page with thumbnail photos and the call to action is clicking the photo or product name to go to the specific product page. Can an experienced adwords person help me understand this better? Do I really want/need to create seperate ppc landing pages? What would the difference be? Thanks as ever Handcrafter
Paid Search Marketing | | stephenfishman0