Is a site map necessary or recommended?
-
We have a website that has been up for the past 4 years without a site map.
Google is indexing it. Do we need a site map? Do you recommend we create one and submit it to goggle and bing?
The site is www.logobids.com
Thank you.
-
Hi Mike,
Thanks for the tip. I checked and our .xml sitemap has 55 pages and Google is indexing 53. not sure what the 2 missing pages are or how to find out, but I imagine the difference may have to do with blog archives or something along those lines. At any rate, I'm reassured by this. Thanks again.
Gina
-
Hi Gina,
If you use Google Webmaster Tools you can see how many pages you submitted on your sitemap and how many Google has indexed under Optimization > Sitemaps.
It will also list if you have an issues with your xml sitemap.
Hope this helps.
Mike
-
I would say that the sitemap is not needed per say, however, it is good practice to have one, whether it be for client navigation around a site or to assist Google with the root navigation of the website.
From the earlier days in my SEO career I was taught to always incorporate a few standard items as basic procedure as they once you are used to the routine you cannot do any harm if even Google no longer needs then, these were things like sitemap.html, sitemap.xml and robot.txt.
It seems like Google is no longer taking a sitemap for the same purpose as it used to as the technology is advancing, so it now seems like personal preference.
A little bit like the old:
"Which should you do first, On-page SEO or Off-page SEO?" debate.
Hope this helps.
-
It's not needed per se, but then if you have a large website and you think about the user and you want them to be easily able to find sections of your website, it can't hurt to have a HTML sitemap.
As for XML sitemap, the only reason I consider doing them to make sure if there are any issues of indexability, I know. So that I can act on that information and do something. Otherwise for a large scale website with over hundreds and thousands of pages, how'd you know if you have a section of your site not indexed for whatever reasons ?
-
This is a strong indicator something is up and deserves deeper investigation.
Perhaps you have content duplication issues, low value content (Panda), spammy back links (Penguin) or other indexing issue. See if there is a pattern to the missing pages, perhaps one of the directories is the cause. How old is the site and how is the domain trust/authority coming along?
-
I'm jumping in here with an offshoot question for Mike. (or anyone else with an idea)
You suggest "If you Google site:logobids.com you can see which of your pages Google has indexed."
I just tried that and only 10 out of 40+ pages on our site are coming up. We have both an html site map and an xml site map on our site. There isn't any noindex code on the site other than for blog comments.
Any idea why Google isn't showing them all?
Thanks!!
-
A stale or poorly created sitemap can hurt in the following ways:
- long lived 404 pages - deleted pages continue to be indexed if not removed from the sitemap
- use up Google indexing allowance - if 404 and low value pages are included, Googlebot will use up valuable indexing allowance on them vs covering more of your important content.
- links to private areas - depending on how the map is created, the tool may not be smart enough to not include administration or community pages that you don't want in the index.
- inclusion of noindex pages - a couple methods (such as a robot.txt update after a sitemap is created) will include noindex pages which a technical problem. I'm not 100% sure of the impact but I could see this being a quality indicator.
- create distracting work - maintaining sitemaps, particularly semi-manual ones from Xenu etc., suck time better spent improving your indexability or earning back links.
However, all of these are easily avoidable with a solid approach and/or good server side tools.
-
Thank you for the responses. It seems like it is something that cant hurt the site or the indexing. The sacrifice is my time, other than that it has nothing but upsides and no downside.
I think we will go forward with creating the site map and submitting to Google.
-
I don't have a site map on any of my sites. Never any problem getting indexed or ranking. None.
-
I may get chastised for this but I believe the value of sitemaps is over stated.
All things being equal, I feel they are crutches and band-aids for poor webdesign/production.
Your site should:
- be easily indexed by all engines
- expose all pages with in four-five links of the home page(s)
- utilize thoughtful linking to promote important content in an organic manner
- expose new content on a high value, frequently indexed page (ie the home page) long enough to be found
- be consistent enough that the site will seem similar after one or two passes by Googlebot.
I like sitemaps when big structural changes occur as the sites heal faster. They're good when a lots of pages are only exposed via a long pagination scheme. I also use them to break down parts of a site to expose problem areas (IE when a sitemap has 50 links but Google only indexes 25 of them)
But, they can be detrimental if they are not maintained properly. If anything changes in the structure, it should be immediately reflected in the sitemap. Lots of automated ones don't consider the robot.txt file which can cause problems.
For SEOs, adding a sitemap is an easy way to ensure everything is at least looked at without having to touch the actual site.
Advice: yes, use them but only if you can use them properly or can't fix current indexing issues. Over the long haul however, you should force yourself to think of it as not there.
-
A sitemap is like a map with driving directions for Google. Sure they can probably find their way through your site, but with a map they can get through more efficiently and make sure to look at all of your pages.
It is not required for a site to get indexed.
If you entire site is indexed, you don't "need" a sitemap; however, it is good practice to have one.
Say you add a new page and want it to get indexed quickly by Google, you would just update your sitemap and submit it to Google. It alerts them you have made changes and to reindex your site.
If you Google site:logobids.com you can see which of your pages Google has indexed.
Hope this helps.
Mike
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
site speed
i use mid-quality pic and... but my site speed is low
On-Page Optimization | | zlbvasgabc
any suggestion?
my site is:
https://bandolini.ir/0 -
Checking for content originality in a site
two part question on original content How would you go about checking if a site holds original content accept the long search quary within Google? ans also if I find many sites carrying my content and I am the original source should I replace the content? thanks
On-Page Optimization | | ciznerguy0 -
Keyword optimization of main keyword across site.
My site is optimized for keyword "payment gateway" but it seems for each keyword only one page should be optimized as per good SEO. So if I've a page about Paypal then how should I spread the keywords? Here the main will be Paypal and site keyword will be payment gateway. It means site should have more Paypal than payment gateway. But can payment gateway be in 3rd or 4th position in density? Similarly how should I create other pages? How search engines determine the site authority based on keyword? ( let us ignore the external backlinks, context of them and anchor texts).
On-Page Optimization | | rag_gupta0 -
Why has my site gone from 3rd to 21st in Google...HELP
Hi there, Web Address: www.websitedesign-miltonkeynes.com Okay I stared my own web development business about 8 - 9 months ago and decided that I was going to target a small number of local keywords that were relevant to my business and geographical area. So I decided to target the keywords below and and started to get good traffic, I never have bought links and have not copied any content although I know i should try and add more content to my website. mk web design, software Milton Keynes, web design Milton Keynes, web design mk, web designer Milton Keynes, web designers Milton Keynes & website design milton Keynes However recently my website has dropped massively in the SERP's and wanted to know what has caused this (i know Penguin) and what I can do to improve. I have listed below my rankings to show you the drop: 24th April 2012 15th May 2012 mk web design 3 11 software milton keynes 1 8 web design milton Keynes 12 50 web design mk 5 53 web designer milton keynes 10 0 web designers milton keynes 6 37 website design milton keynes 3 21 I decided to change my homepage Page Title a week ago to make sound less spammy but this has made no difference and wanted some help on what has happened so i do not do this again and what I can do to improve. Thanks in advance. Darren Bowden
On-Page Optimization | | Tarqs0 -
My site has been dropping, not sure why!
My site has been dropping in the rankings, not sure - my metrics seem better than my competitors. Historically I have been a very stable #2 for my main term, but now it's down to 7! According to SEO Moz, my domain authority is 32, while my better performing competitors are are 26, 11, and 1! Have more links than they do. Trying to think it through, not sure what is happening. My home page bounces at a low 20%-ish, other Google Analytics are good. I have a company Facebook account, occasionally upload YouTube vids, do online press releases, etc. I do have to target several metros scattered across the state, while my competitors usually focus on one major metro. I do have some SEO Moz errors, which focus on dup content due to our web editor's naming system. An example would be domain.com/keyword-keyword-i-14 vs. domain/differnet keyword-different better keyword-i-14. 14 would be the actual page number. Our system lets me change the page title keywords, as I've added new links and pages over the years there are some dupes. The only major change is I've added a password protected section for sales rep materials. The hosting/web guru firm we use has assured me Google doesn't see pages behind the password portection. Not sure if Google is testing a new SERP formula. All social media or non-website results seem to have dropped out of search for my terms. Just local business sites like mine and some directory sites remain. Any advice or private consult would be greatly appreciated as I am a ... self taught 'OneManBand' for high tech marketing in our company. Thanks
On-Page Optimization | | OneManBand0 -
Is Top Level Brand Page Necessary?
We currently a variety of brand landing pages on our e-commerce site. What’s slightly unusual here is these brand landing pages all belong to a Men’s or Women’s category. Typically, e-commerce sites have one level up in the hierarchy where you can go to a general index brand landing page from which you can then select Men’s or Women’s products for that brand. For example, here’s what we have currently: www.site.com/mens-brandx www.site.com/womens-brandx We do NOT have a layer-above page like this: www.site.com/brandx that would allow you to see the full consolidated selection of Brand X items with nav links for Men’s and Women’s to drill down further. We think this divided approach might be hurting our rankings for brand-oriented keywords, many for which we have inventory in both the men’s and women’s markets. If a user were to search for something that isn’t gender-specific like “brand X apparel”, the search engines would need to decide which page, men’s vs women’s, is more relevant. So we are wondering if our SEO concerns are valid before investing in creating all the new pages and maintaining all three.
On-Page Optimization | | Swell.com0 -
Major update to site architecture (outline)-Is Google going to drop?
I'm working with a lawyer client who has a table-based, outdated site. Her nav links consist of a jumble of topics and static pages in one long sidebar list on the home page. I'm moving her site to Wordpress and I've recommended that she organize the site based on categories that roughly match the topics/keywords she wants to rank highest for in Google. The site will be much better organized and coded and the URLs for the new launch will be much stronger for SEO by being targeted and coded properly. So the site should rank better after, right? Right??? I know that when Google crawls the new architecture, it's not going to find the expected long sidebar list of internal nav links. It'll find better, more keyword targeted internal nav links. But will that keep the site from getting dropped off page 1? I'm speaking w/ the client tomorrow and if she's going to drop or get bounced around, I feel like I should prepare her and let her know roughly what might happen. I'm thinking based on my current understanding that I should tell her to expect to be bounced around for a few weeks, but in the end she should rank higher than before. What would you do/say?
On-Page Optimization | | bvrob0 -
Three Sites or One?
I have a client who provides three distinct, although related, services. Some of his competitors only provide one of those services, and thus their sites are more saturated with that particular service. Would it be best to develop three different sites optimized for each particular service, or could I achieve the same effect by optimizing different sections of one site for each service?
On-Page Optimization | | kscotbarr0