Why are Seemingly Randomly Generated URLs Appearing as Errors in Google Webmaster Tools?
-
I've been confused by some URLs that are showing up as errors in our GWT account. They seem to just be randomly generated alphanumeric strings that Google is reporting as 404 errors. The pages do 404 because nothing ever existed there or was linked to. Here are some examples that are just off of our root domain:
/JEzjLs2wBR0D6wILPy0RCkM/WFRnUK9JrDyRoVCnR8=
/MevaBpcKoXnbHJpoTI5P42QPmQpjEPBlYffwY8Mc5I=
/YAKM15iU846X/ymikGEPsdq 26PUoIYSwfb8 FBh34=
I haven't been able to track down these character strings in any internet index or anywhere in our source code so I have no idea why Google is reporting them.
We've been pretty vigilant lately about duplicate content and thin content issues and my concern is that there are an unspecified number of urls like this that Google thinks exist but don't really.
Has anyone else seen GWT reporting errors like this for their site? Does anyone have any clue why Google would report them as errors?
-
Glad to hear you located the root cause of the issue.
-
Update: I think I found the source of the errors. We have a form submission box on every page of our site and there are random alphanumeric strings that are unique to every page that look like these urls that Google is reporting as errors. Maybe Google is trying to use our form submission tool.
It's still really odd that Google would think they are urls and report them as errors since they appear in an tag not an <a> tag</a>
<a>```
<input id="authenticity_token" name="authenticity_token" type="hidden" value="ElCkBCszxMddaqVyVIx+flkzRlM9xb7mHb3cFISlJvY=" /> -
The next step would be to check Google WMT > Diagnostics > Crawl errors > Not Found tab
Click the "Linked from Detected" text. That will show the source of the link.
-
That's not the case. We have an in house content system and no shopping cart. These urls return a 404 error and always have because they've never existed.
No crawlers have returned urls that look like this either. I can't get these urls to show up in Google's index either.
-
Hi Jimmy,
My bet is you are using a CMS or Shopping Cart on your site. The software is generating these seemingly random URLs, and the Google crawler is seeing them.
Crawlers don't move through your site the way people do. If you take your home page and right-click, then choose View Page Source, you will find many URLs. The crawler will then follow each and every URL throughout your site. The URLs you are seeing could be generated on any given page.
To track the issue, use the SEOmoz crawler on your site, then analyze the results. When you find these types of URLs, take note of the page they are located on.
Alternatively, you can contact your CMS or shopping cart's software developer and inquire about the URLs. If these URLs show a folder path before the random characters, that information can help track down which pages or software is generating these pages.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Webmaster Tools V. OSE Backlinks to Disavow
Hey Everybody, So I am getting to the point where I need to disavow some backlinks. I am noticing a discrepancy between the OSE backlinks and the GWMT backlinks. My question is do I put both sets of links in the Disavow tool? Just the links from GWMT? Just the links from OSE? Etc... Etc... Thanks Everybody!
Reporting & Analytics | | HashtagHustler0 -
Sudden Increase In Number of Pages Indexed By Google Webmaster When No New Pages Added
Greetings MOZ Community: On June 14th Google Webmaster tools indicated an increase in the number of indexed pages, going from 676 to 851 pages. New pages had been added to the domain in the previous month. The number of pages blocked by robots increased at that time from 332 (June 1st) to 551 June 22nd), yet the number of indexed pages still increased to 851. The following changes occurred between June 5th and June 15th: -A new redesigned version of the site was launched on June 4th, with some links to social media and blog removed on some pages, but with no new URLs added. The design platform was and is Wordpress. -Google GTM code was added to the site. -An exception was made by our hosting company to ModSecurity on our server (for i-frames) to allow GTM to function. In the last ten days my web traffic has decline about 15%, however the quality of traffic has declined enormously and the number of new inquiries we get is off by around 65%. Click through rates have declined from about 2.55 pages to about 2 pages. Obviously this is not a good situation. My SEO provider, a reputable firm endorsed by MOZ, believes the extra 175 pages indexed by Google, pages that do not offer much content, may be causing the ranking decline. My developer is examining the issue. They think there may be some tie in with the installation of GTM. They are noticing an additional issue, the sites Contact Us form will not work if the GTM script is enabled. They find it curious that both issues occurred around the same time. Our domain is www.nyc-officespace-leader. Does anyone have any idea why these extra pages are appearing and how they can be removed? Anyone have experience with GTM causing issues with this? Thanks everyone!!!
Reporting & Analytics | | Kingalan1
Alan1 -
Is Google still differentiating TLD?
I need to find an article or something with factual findings that shows Google no longer gives extra value to .com, .net, .us, edu. etc. or proving that is still does.
Reporting & Analytics | | PPI0 -
Bing vs Google Keyword Research
Hi All, I have carried out keyword research based on Google Analytics, Keyword Planner, competitors and various other toolsets.
Reporting & Analytics | | Mark_Ch
My research has been based on performance metrics favored towards Google.
I'm looking to research keyword traffic metrics and suggestions based on Bing Ads Intelligence. My Logic
I have compiled my master list based on Google metrics.
I will carry out Bing search traffic metrics based on my Google master list.
I will carry out Bing keyword suggestions based on my Google master list. My Questions
#1 Will my logic yield me any favorable benefits based on the high number of Google users vs Bing users
#2 Should Bing favor a particular keyword with high search traffic compared to Google, is there a fear that creating a 'seo user friendly website page' could dilute link juice based on the high Google users. Any other useful advice would be welcome. Regards Mark0 -
Google Analytics - Not provided info
Morning all, i am using Google analytics for some time now, One of the issues that i don't have a clear answer for is, when i am looking at Traffic Source --> overview In the Keyword column, that is a line (not provided) What we think here is that we cant see the keywords if someone arrived to our website but was logged-in to Google account Is this correct? is there a way to find the keywords behind this (not provided)? - i have many visits for this line (17.3% of all visits) and i don't know which keywords people used. Thank you SeoWise
Reporting & Analytics | | iivgi0 -
Get a list of robots.txt blocked URL and tell Google to crawl and index it.
Some of my key pages got blocked by robots.txt file and I have made required changes in robots.txt file but how can I get the blocked URL's list. My webmaster page Health>blocked URL's shows only number not the blocked URL's.My first question is from where can I fetch these blocked URL's and how can I get them back in searches, One other interesting point I see is that blocked pages are still showing up in searches.Title is appearing fine but Description shows blocked by robots.txt file. I need urgent recommendation as I do not want to see drop in my traffic any more.
Reporting & Analytics | | csfarnsworth0 -
Results Google in different browsers
I have changed one of my company pages. Now I saw that the Google position is different using IE of Firefox. In IE we are at position 1, in Firefox we are at position 4. Does anybody know, why this is? And how I could change this for different browsers? At the end the results are from Google.
Reporting & Analytics | | vliegticketsnl0 -
Backlinks on Google Webmaster Tools
As I was reviewing my Google Webmaster tools, I notices a major drop in the number of back links. It used to show over 4,500 links to my site yet the other day it dropped down to 41. None of the directories I've submitted to are showing, nor any blog comments I've posted. Since then, my SEO traffic has started to drop for some keywords. Anyone know why?
Reporting & Analytics | | MikeAndres0