Is it OK for a sitemap to appear as a "Top URL" in Google Webmaster?
-
I'm using Google Webmaster (alongside other tools) to understand how Google is indexing my site.
One of the tools is "Content Keywords", where it lists keywords that Google sees as significant for your site. The keywords shown are generally fine, but when I click on an individual word, I am often seeing our sitemap as one of the "Top URLs" that the keyword is found on (our sitemap is at system/sitemap1.xml.gz) - is this OK?
Obviously I don't want to add the sitemap URL to robots.txt, but I also want to ensure that 'real' user-focused pages (e.g. our homepage) appear higher in the "Top URLs" list for the keywords, as I'm assuming this is an indicator of how the site is performing in search.
Any help appreciated!
-
Thanks for the answer. However I'm still unclear on a few things so I thought I'd give some further info:
- We actually have two XML sitemaps - one for our main site including our forums (this sitemap is generated/submitted by a ruby on rails plugin) and one for blog posts and static pages (this sitemap is generated by a Wordpress plugin). The sitemap which is appearing as a "Top URL" is the first one
- There are actually no links to our sitemap anywhere on our site - the only way Google knows about it is because we automatically generate and submit it to Webmaster
I think the reason that it is appearing as a Top URL is because all of the page titles of forum posts are listed in the sitemap, and this is the only page where they are all listed on one page. So I think you are right about the 'simple algorithm' thing, but I think it's because of the frequency of the keyword in the sitemap, rather than because the sitemap is linked to from anywhere on the site (because it's not).
This brings me to a related question - is it bad having two separate XML sitemaps, and should I be linking to them somehow from the site?
-
I wouldn't be overly concerned.
For some terms, especially product codes and the detail pages of your site there are probably only going to be three pages where that term appears. The product page itself, the page within the navigation that links to that page (normally a list), and the sitemap.
Your sitemap is probably heavily linked to across the site so it does kind of make sense that it would appear as one of the top URLs for a term.
The reason I wouldn't be overly concerned is that I would IMAGINE (and I could be totally wrong) that the top Pages list is generated by a very simple algorithm that doesn't reflect how the organic search algorithm sees your site.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
"Cookies are required to access this site" in Google Serp?
One of my clients is having an issue where their Google search result title and description are just showing "Cookies are required to access this site." instead of the actual meta values. The problem is only in Google as Yahoo and Bing seem to be fine. You can see in the image below or by running a search your self for "be well bodyworks longmont" I've never seen anything like it and couldn't find any reference to anyone else having this issue... I would very much appreciate any insight as to what is going on. Thanks! c5PGL
Technical SEO | | CampfireDigital0 -
Where did the "Location" go, on Google SERP?
In order to emulate different locations, I've always done a Google query, then used the "Location" button under "Search Tools" at the top of the SERP to define my preferred location. It seems to have disappeared in the past few days? Anyone know where it went, or if it's gone forever? Thanks!
Technical SEO | | measurableROI0 -
Why are these URL's suddenly appearing in WMT?
One of our clients has suddenly experienced a sudden increase in crawl errors for smart phones overnight for pages which no longer exist and there are no links to these pages according to Google. There is no evidence as to why Google would suddenly start to crawl these pages as they have not existed for over 5 years, but it does come after a new site design has been put live. Pages do not appear to be in the index when a site search is used. There was a similar increase in crawl errors on desktop initially after the new site went live, but these quickly returned to normal. Mobile crawl errors only became apparent after this. There are some URL's showing which have no linking page detected so we don't know where these URL's are being found. WMT states "Googlebot couldn't crawl this URL because it points to a non-existent page". Those that do have a linking page are showing an internal page which also doesn't exist so it can't possibly link to any page. Any insight is appreciated. Andy and Mark at Click Consult.
Technical SEO | | ClickConsult0 -
Can anyone help me understand why google is "Not Selecting" a large number of my webpages to include when crawling my site.
When looking through my google webmaster tools, I clicked into the advanced settings under index status and was surprised to see that google has marked around 90% of my pages on my site as "Not Selected" when crawling. Please take a look and offer any suggestions. www.luxuryhomehunt.com
Technical SEO | | Jdubin0 -
Received Google Webmaster Tools notice of detected unnatural links , but no negative impact on ranking and traffic, What should i do next?
Hello, On May 19 , 2012 Google webmaster sent notification "Google Webmaster Tools notice of detected unnatural links to " both sites haven't lost any ranking or traffic as yet. I am worried, Should i panic,what should i be doing , will it be going down anytime soon? how to naturally build links?
Technical SEO | | conversiontactics0 -
I have a lot of warnings for "Overly-Dynamic URL"
I have a lot of warnings for "Overly-Dynamic URLs" but all the pages listed have a canonical with a static url , does this mean that I can ignore the warnings? Seems to me that I can but I just want to make sure?
Technical SEO | | Arnx1 -
What to do about "blocked by meta-robots"?
The crawl report tells me "Notices are interesting facts about your pages we found while crawling". One of these interesting facts is that my blog archives are "blocked by meta robots". Articles are not blocked, just the archives. What is a "meta" robot? I think its just normal (since the article need only be crawled once) but want a second opinion. Should I care about this?
Technical SEO | | GPN0 -
"/" at the end of a URL
I just noticed that I have the exact same page showing up separately in my Google Analytics reports. One has a "/" at the end and the other does not. Otherwise, these are the exact same URL's. Is this something I need to be aware of from a duplicate content perspective? If so, how do I go about fixing this? I thought the SE's would automatically see that a URL with a "/" at the end is the same as one without, but if that is the case, why is it showing up in my reports as two separate pages?
Technical SEO | | Blockinc0