XML SiteMap - Right Away or Delay?
-
So, I have a new client whose web designer declined to create an XML site map. They said that they would rather wait a year and let Google create one.
I am wondering what the opinion of other SEOMoz members is about this--do you create an XML right away or think there is an advantage in delaying?
Personally, I always prefer to have one right away--What is the best practice in your experience and why?
-
I hate when I reply and it doesn't post!
Thanks Ryan,
Appreciate your sharing your experience in submission before posts are made. I would not have thought about doing one for subdomains--great insight and suggestion.
The site in question has been up a while and is pretty comprehensive so I thought it would be a good practice. Another site I am working on did not have one either and it will be interesting to see how the XML sitemap added today will impact it.
Thanks again to all of you for chiming in. Very helpful, I just had not heard of someone declining to create one as a general practice before.
-
Todd, I appreciate your suggestion about the video site map. That is a great idea that I did not think of!
So, I must confess that I've been remiss about using Webmaster Tools but as my sophistication has increased, I am expanding my use of other tools for a more comprehensive approach.
-
Thanks Martijn,
I've mainly been an SEO writer until this last year or so and almost exclusively work on small business websites.
I take an initial look at the indexing of the pages on Yahoo, Google and Bing and then monitor it over time. Since I do a lot of work for web designers, my preference for XML sitemaps is just one of practice.
It seems that many small business sites do not include them and I like to work to get them an edge in many different ways. Many have horrible sites that need all the help they can get!
-
Martijn and Todd share some good points. I'll add a different viewpoint. If your site offers solid navigation and no island pages, sitemaps are completely unnecessary.
When you register your site, Google will begin attempting to crawl the main page of the site. If you offer standard, crawlable navigation, then Google will find every page on your site naturally. Sitemaps offer Google and Bing a list of links to your site's pages. If a link is noticed in your sitemap which has not been otherwise crawled, then your sitemap offers an opportunity for search engines to crawl the page.
As for timing, just be sure there is actual content on your site prior to submitting a sitemap. I had once installed forum software on a site and then submitted a sitemap to Google prior to any posts being made. I received a penalty notice and had to submit a reconsideration request to have the site later indexed.
There are only a few cases where I can see the benefit of submitting a sitemap. A couple examples:
-
if you add a new sub-domain which is otherwise not linked to by your main site
-
if you add an island page to your site which you wish to be indexed
-
-
Hola!
google has this to say about submitting sitemaps "Submit a Sitemap to tell Google about pages on your site we might not otherwise discover." ala Webmaster tools. I stand firmly behind your inkling to create a good standard issue sitemap and submit. Last week we had a client (attorney) who did not have a sitemap at all for the three years her site was up, google had about 22 pages in its index, after sitemap, 432 pages in its index. Be sure to submit to BIng webmaster tools as well, cover all bases!
so I say create right away, its not going to hurt anything, and can quite honestly help a lot! as a footnote to this answer, if you are using videos, etc... on the site be sure to build a video sitemap as well we have been seeing a lot successful indexing of our clients media.
Hope this helps!
-
For our company/websites we used different methods of submitting our sitemaps, but until now I prefer submitting the XML sitemaps after a couple of weeks/months (it varies with the kind of website). For us this had a couple of reasons, these were the main ones:
- Insights in your ("natural") crawl stats: By waiting a couple of weeks/months with submitting your sitemaps to Google we were able to see the "natural" crawl stats of our websites.
- Analyse the differences: This also applies to the reason I mentioned above. If you wait you are able to see the difference in your crawl stats after submitting your sitemap to Google. You are not definitely sure if this is directly correlated to you submitting your sitemap of course. But at least you could have a look.
But there are sure also reasons for directly submitting a sitemap: you are directly able to segment your urls, so you can see which segments of your website need to be optimized. And the number of pages crawled vs indexed.
I would like to know your own answer to the question. Why do you prefer submitting a XML sitemap right away?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How important is anchor text in your sitemap?
I've read in a few recent articles that using keyword anchor text in your HTML sitemap is a good idea i.e. important. How important do you think it is? I'd love to hear your thoughts. Example 1: Widgets: View All Colors: Red | Blue | Green | Yellow | Orange | Purple Types: Oversized | Large | Small | Miniature Example 2: Widgets: View All Widgets Colors: Red Widgets | Blue Widgets | Green Widgets | Yellow Widgets | Orange Widgets | Purple Widgets Types: Oversized Widgets | Large Widgets | Small Widgets | Miniature Widgets
Web Design | | Choice0 -
How to optimise non-homepage to beat homepage in rankings? Are we on right path?
Hi all, We have a page with "keyword" in slug like "website.com/keyword" where our homepage is "website.com". This "keyword" difficulty is very high, so every minor factor contributing here and we have noticed competitors' pages with "keyword" in URL ranking. Then we also planned to rank this page "website.com/keyword" and interlinked high, so it'll be favoured by Google which didn't happen. So may be we should reduce the interlinking to homepage and optimise this keyword page more to rank for this keyword. Still I doubt the chances of ranking this page is difficult and need much more. How to make this page ranked replacing homepage? If there are no options for this, we are planning to redirect our homepage to this page; so Google will slowly adopt it. Suggestions please. Thank you.
Web Design | | vtmoz0 -
HTML and XML sitemaps for one website.
Hi all, First, we have created a HTML sitemap for our wordpress website. Then we again generated XML sitemap and submitted same in search console. It's been more than a week and still new XML sitemap has not been indexed yet. I can still only see HTML sitemap for search results "company sitemap". Also search console do have only XML sitemap. Both sitemaps are accessible but only HTML has been indexed. Is there anything wrong having 2 sitemaps? Why XML sitemap not been indexed? Thanks
Web Design | | vtmoz0 -
Do we need both an .XML Sitemap and a .aspx sitemap?
Hi Mozers, We recently switched servers and it came to my attention that we have two sitemaps a XML version of the sitemap and a .aspx version of the sitemap. This came to light as the .aspx version of the sitemap is causing the site to come to a screeching halt as it has some complex code and lists over 80,000 products. My question is do we need both versions of the sitemap? My understanding is that the XML version is for Search Engine bots and the .aspx version is for customers. I can't imagine that anyone is using our .aspx version as it is basically a page with 80,000 links and it's buried away on the site, so we were hoping to kill off the .aspx version of the sitemap and keep the .xml version for Search Engine Bots. I wanted to check here first to make sure we did not any negative search engine implications. Any help would be most appreciated. Thanks so much! Patrick
Web Design | | gatorpool0 -
Sitemap Update Frequency?
Hello, My question today is regarding sitemaps. I'm often confused by this and because I am a bit obsessive I believe I may be giving myself more work than needed.. Basically my question is, do I need to update and/or re-generate my sitemap every time I make a change to the site? I mean, I must have to if I add a page, correct? And so in Google's Webmaster Tools, do I just delete the current sitemap and re-upload a new one for Google to crawl? Is it possible to overdo this? Any sitemap suggestions would be fantastic. I feel like there's been a few weeks where I've updated the sitemap daily and re-submitted it and I worry that might be hurting my site. Thanks!
Web Design | | jesse-landry0 -
Best Way to Remove Mutltiple XML Sitemaps From Multiple Subdomains
Just found a series of of XML sitemaps hosted like so: http://www.thesite.anothersite.com/sitemap.xml and defaulted to remove and 301 redirect but as this is the first time I've encountered an issue like this, an outside opinion or two would be much appreciated. Is the 301 the best option, should I 404 them or what?
Web Design | | ePageCity0 -
XML Sitemap that updates daily/weekly?
Hi, I have a sitemap on my site, that updates but it isn't a XML sitemap. See here: http://www.designerboutique-online.com/sitemap/ I have used some free software to crawl the site and create a sitemap of pages, however I think that if I were to upload the sitemap, it would be out of date as soon as I listed new products on the site, so would need to rerun it. Does anyone know how I can get this to refresh daily or weekly? Or any software that can do it? I have a web firm that are willing to do one, but our relationship is at an all time low and I don't want to hand over £200 for them to do one. Anyone with any ideas or advice? Thanks Will
Web Design | | WillBlackburn0 -
Why is our sitemap not being indexed on Webmaster Tools?
Hi there, We have been having a problem with one of our websites. It appears as though someone has stolen our template and used it for themselves, but in the process also stole our analytics information. We have problems with the analytics, but are fixing that ourselves. The problem we have now is that when we tried to put in a sitemap into Google Webmaster Tools the URLs are submitted but have yet to be indexed. We have tried pinging them, but there has been no change. This is not a problem for our other websites which are very similar. What could be the problem here? For reference, the url is http://www.dentistinlittlerock.com Thank you for your responses in advance!
Web Design | | jid0