Is a site map necessary or recommended?
-
We have a website that has been up for the past 4 years without a site map.
Google is indexing it. Do we need a site map? Do you recommend we create one and submit it to goggle and bing?
The site is www.logobids.com
Thank you.
-
Hi Mike,
Thanks for the tip. I checked and our .xml sitemap has 55 pages and Google is indexing 53. not sure what the 2 missing pages are or how to find out, but I imagine the difference may have to do with blog archives or something along those lines. At any rate, I'm reassured by this. Thanks again.
Gina
-
Hi Gina,
If you use Google Webmaster Tools you can see how many pages you submitted on your sitemap and how many Google has indexed under Optimization > Sitemaps.
It will also list if you have an issues with your xml sitemap.
Hope this helps.
Mike
-
I would say that the sitemap is not needed per say, however, it is good practice to have one, whether it be for client navigation around a site or to assist Google with the root navigation of the website.
From the earlier days in my SEO career I was taught to always incorporate a few standard items as basic procedure as they once you are used to the routine you cannot do any harm if even Google no longer needs then, these were things like sitemap.html, sitemap.xml and robot.txt.
It seems like Google is no longer taking a sitemap for the same purpose as it used to as the technology is advancing, so it now seems like personal preference.
A little bit like the old:
"Which should you do first, On-page SEO or Off-page SEO?" debate.
Hope this helps.
-
It's not needed per se, but then if you have a large website and you think about the user and you want them to be easily able to find sections of your website, it can't hurt to have a HTML sitemap.
As for XML sitemap, the only reason I consider doing them to make sure if there are any issues of indexability, I know. So that I can act on that information and do something. Otherwise for a large scale website with over hundreds and thousands of pages, how'd you know if you have a section of your site not indexed for whatever reasons ?
-
This is a strong indicator something is up and deserves deeper investigation.
Perhaps you have content duplication issues, low value content (Panda), spammy back links (Penguin) or other indexing issue. See if there is a pattern to the missing pages, perhaps one of the directories is the cause. How old is the site and how is the domain trust/authority coming along?
-
I'm jumping in here with an offshoot question for Mike. (or anyone else with an idea)
You suggest "If you Google site:logobids.com you can see which of your pages Google has indexed."
I just tried that and only 10 out of 40+ pages on our site are coming up. We have both an html site map and an xml site map on our site. There isn't any noindex code on the site other than for blog comments.
Any idea why Google isn't showing them all?
Thanks!!
-
A stale or poorly created sitemap can hurt in the following ways:
- long lived 404 pages - deleted pages continue to be indexed if not removed from the sitemap
- use up Google indexing allowance - if 404 and low value pages are included, Googlebot will use up valuable indexing allowance on them vs covering more of your important content.
- links to private areas - depending on how the map is created, the tool may not be smart enough to not include administration or community pages that you don't want in the index.
- inclusion of noindex pages - a couple methods (such as a robot.txt update after a sitemap is created) will include noindex pages which a technical problem. I'm not 100% sure of the impact but I could see this being a quality indicator.
- create distracting work - maintaining sitemaps, particularly semi-manual ones from Xenu etc., suck time better spent improving your indexability or earning back links.
However, all of these are easily avoidable with a solid approach and/or good server side tools.
-
Thank you for the responses. It seems like it is something that cant hurt the site or the indexing. The sacrifice is my time, other than that it has nothing but upsides and no downside.
I think we will go forward with creating the site map and submitting to Google.
-
I don't have a site map on any of my sites. Never any problem getting indexed or ranking. None.
-
I may get chastised for this but I believe the value of sitemaps is over stated.
All things being equal, I feel they are crutches and band-aids for poor webdesign/production.
Your site should:
- be easily indexed by all engines
- expose all pages with in four-five links of the home page(s)
- utilize thoughtful linking to promote important content in an organic manner
- expose new content on a high value, frequently indexed page (ie the home page) long enough to be found
- be consistent enough that the site will seem similar after one or two passes by Googlebot.
I like sitemaps when big structural changes occur as the sites heal faster. They're good when a lots of pages are only exposed via a long pagination scheme. I also use them to break down parts of a site to expose problem areas (IE when a sitemap has 50 links but Google only indexes 25 of them)
But, they can be detrimental if they are not maintained properly. If anything changes in the structure, it should be immediately reflected in the sitemap. Lots of automated ones don't consider the robot.txt file which can cause problems.
For SEOs, adding a sitemap is an easy way to ensure everything is at least looked at without having to touch the actual site.
Advice: yes, use them but only if you can use them properly or can't fix current indexing issues. Over the long haul however, you should force yourself to think of it as not there.
-
A sitemap is like a map with driving directions for Google. Sure they can probably find their way through your site, but with a map they can get through more efficiently and make sure to look at all of your pages.
It is not required for a site to get indexed.
If you entire site is indexed, you don't "need" a sitemap; however, it is good practice to have one.
Say you add a new page and want it to get indexed quickly by Google, you would just update your sitemap and submit it to Google. It alerts them you have made changes and to reindex your site.
If you Google site:logobids.com you can see which of your pages Google has indexed.
Hope this helps.
Mike
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEO Rankings Ebbs and Flows on Ecommerce Site - Normal?
Hey everyone, I should start by saying I'm very new to SEO (I'm actually just a copywriter that's taken on this role at an agency), so I apologize if I'm using some common terms incorrectly or if there's a lack of information. I've been optimizing my first ecommerce website (clothing company), and things were going very well last year. Strong surges in organic traffic, peaking in the summer. There was a drop before the holidays when the client dumped a ton of new product pages that weren't optimized. After optimizing the pages, the traffic went back up to its summer levels. Now, there's about a 10% drop in organic traffic since earlier this year, and a loss of just over 20% of keywords the site was originally ranking for. There's no sharp drop in the Analytics, but a steady decline. To give a better idea, the site was ranking for 5,270 keywords in February; it's dropped to 3,772 keywords in April. According to SEMRush, almost all the dropped keywords are the lower volume ones, maybe indicating long tail keywords? I'm really not sure what the cause of the drop is, as I've been following (I think) best on-page practices, which seems to have yielded results last year. One thing I should mention is the client has a unique product page for each variant of one product (so the same shirt will have 10 of the same pages, the only difference being the colour). Could Google be penalizing the site for duplicate content? It was fine last year though with that same site structure; I'm not sure how long it would take for Google to penalize a site for that. Sorry for the wall of text. I'd really appreciate any insight into this. Thanks Moz community!
On-Page Optimization | | EdenPrez3 -
"Turning off" content to a site
One site I manage has a lot of low quality content. We are in the process of improving the overall site content but we have "turned off" a large portion of our content by setting 2/3 of the posts to draft. Has anyone done this before or had experience with doing something similar? This quote from Bruce Clay comes to mind: “Where a lot of people don’t understand content factoring to this is having 100 great pages and 100 terrible pages—they average, when the quality being viewed is your website,” he explained. “So, it isn’t enough to have 100 great pages if you still have 100 terrible ones, and if you add another 100 great pages, you still have the 100 terrible ones dragging down your average. In some cases we have found that it’s much better, to improve your ranking, to actually remove or rewrite the terrible ones than add more good ones.” What are your thoughts? Thanks
On-Page Optimization | | ThridHour0 -
Keyword usage in eCommerce Sites - Danger of keyword stuffing?
Hi all, I'm having a little difficulty deciding the best approach for selecting my product titles as I've encountered a few issues. I understand how important it is to try and use the keyword in your product titles, but about the category page that lists all of these products? One of category pages, for example, has 16 products on it. Each has the product title followed by the keyword. I have also used the keyword in the category title, URL, breadcrumbs and two or 3 times (because it was natural) in a paragraph that describes the category etc. Due to the little amount of text on the page, and the sheer amount of times that the keyword is being used, it looks like I am keyword stuffing (By Moz On Page Report Card). I think it came to 23 uses of the same keyword altogether. This is the pretty much teh same throughout every category page on my site, and think I was penalised by Google for this reason. I'm a relatively new site and have done everything by the book as far as I know, so everything is pointing at this to be the cause of the drop/disappearance in ranking. How do I rectify this problem? It's important for the products to have the keyword in, right? As this is one of the SEO practices that is given more weight when considering rankings. I have thought a potential way around this, which is to split the keyword between an exact match, and a variant of the keyword in the titles - only very slightly though. So my product titles would look like 'Product A Exact Match Keyword', 'Product B Variant on Keyword' etc. Could this work? Can anybody advise on the best thing I could try? I have attached an image to give you an idea of the layout of my category pages - Apologies in advance about my embarrassingly rubbish photoshop skills! I wasn't able to upload directly, so I have attached a link. Thanks for reading, John 4iIkmSx
On-Page Optimization | | John_Francis0 -
How Google differentiates web sites like directories?
Hi, I want to ask how google differentiates web sites like directories or company listing websites? How it understands that is a normal thing to have many links in a directory site? Are there some guides links about what to do and avoid and how to make SEO optimization for a directory web site.
On-Page Optimization | | vladokan0 -
How do you avoid getting hit for too many links with an ecommerce site?
On my campaign for www.fourcolormagnets.com one of my warnings was "too many on-page links". Is there any thing to do for ecommerce sites? and also, my page www.fourcolormagnets.com/rectangle-sizes.php is listed as having 744 links but, I count nowhere near that number. And idea where this comes from?
On-Page Optimization | | JHSpecialty0 -
Customer Review Capture / Google Approved Review Sites
We are interested in showing customer reviews on our website (in UK for seo purposes- UGC) and are initially reluctant to use a 'What customer say' or Testimonial page as we think customers may think we have just made these reviews up? I wanted to ask what methods you folks use to capture reviews? If you use 3rd party providers do you have any recommendations? (I found this link but it seems a little outdated as it doesn't include for example eKomi:http://www.seomoz.org/blog/how-to-rank-well-in-google-products-search-a-big-list-of-places-to-get-reviews) Thanks in advance.
On-Page Optimization | | jannkuzel0 -
Best way to optimize site for Google Maps?
I am working with a site right now and they are ranked #1
On-Page Optimization | | WhiteHat12
for many keyword phrases based on their location and service. Their service is an
Insurance agency, so they rank #1 for many keywords like “Miami Insurance” or “South
Florida Insurance Agency” (their not actually ranked for Miami
just giving an example). I also include their address on every page of the site
(maybe that better helps Google maps?). Problem I am having is when searched
just the keyword phrase they rank number 1 but when searching say “insurance”
while being logged in to the area they rank for they do not come up. I hear that
there might be specific ways to optimize for this. What I would like to know is
what would I have to do to optimize for Google maps and what’s everything I possibly
can do. I am good with search engine optimization but have never really dabbled
much with Google Maps, I always thought they just ranked you based on your
address.0 -
Should our social network put all of our member profiles in the site map?
We're working on some changes to our site and want to add a site map file to give some hints to search engines on our member profiles. Our site has millions of member profiles. I want to ensure that Google indexes them. Is there a benefit to submitting millions of profiles across multiple site maps? Is it better to pick a sample of those and submit them? Most member profiles have links to other member profiles. Is there any benefit to taking a single site map of 50k links and then changing it at some frequency so that all of the member profiles are eventually indexed? Thanks.
On-Page Optimization | | JoeCotellese810