How to determine if my site map needs work?
-
I recently spoke to a consultant at a search conference who took a look at my site map and mentioned it looked like google would have a hard time crawling the site and indexing new pages and changes. I am managing an ecommerce site with a bunch of products, however, I am not an XML expert by any means so i'd appreciate any advice on what to look for in the site map that would possibly be affecting googles ability to crawl/index.
-
I think so. You can always run it through a sitemap validator like this one: http://www.validome.org/google/ I'm sure this will give you everything that you need to know. The 404's are pretty normal as long as you are monitoring them and making sure that they are 404's that you want, or if not you might create 301 redirects, etc.
Hope that helps!
-
thanks for the response..the sitemap is loaded in webmaster tools, and google says there are only a handful of errors (less than 25 and all look like 404 responses due to a page not existing). Based on this, it sounds like all is okay right?
-
Have you loaded the sitemap into Google Webmaster Tools? That's a good starting point because Google will tell you where most of the problems are and give you suggestions on how to fix them. One of the most common things I have seen is having characters in the Product names or descriptions that XML doesn't like, i.e. HTML.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Multiple sites using same text - how to avoid Google duplicate content penalty?
Hi Mozers, my client located in Colorado is opening a similar (but not identical) clinic in California. Will Google penalize the new California site if we use text from our website that features his Colorado office? He runs the clinic in CO and will be a partner of the clinic in CA, so the CA clinic has his "permission" to use his original text. Eventually he hopes to go national, with multiple sites utilizing essentially the same text. Will Google penalize the new CA site for plagiarism and/or duplicate content? Or is there a way to tell Google, "hey Google, this new clinic is not ripping off my text"?
Web Design | | CalamityJane770 -
Regarding rel=canonical on duplicate pages on a shopping site... some direction, please.
Good morning, Moz community: My name is David, and I'm currently doing internet marketing for an online retailer of marine accessories. While many product pages and descriptions are unique, there are some that have the descriptions duplicated across many products. The advice commonly given is to leave one page as is / crawlable (probably best for one that is already ranking/indexed), and use rel=canonical on all duplicates. Any idea for direction on this? Do you think it is necessary? It will be a massive task. (also, one of the products that we rank highest for, we have tons of duplicate descriptions.... so... that is sort of like evidence against the idea?) Thanks!
Web Design | | DavidCiti0 -
Help needed on URL structures
I am busy structuring URL's for a client and an issue i have come across is as follows: i have a URL that is a long one, we cant remove words in it so the question is which one is better structurally: root/courses/businessmanagementandadministration.aspx or root/courses/business-management-and-administration.aspx please help.
Web Design | | nick_pageone0 -
I am looking to build an informational site that consists of a few landing pages. What kind of platform would you recommend?
The site would consist of an initial homepage, about us page, products & services page, sub-category pages that consist of the products and services in greater detail, and a contact us page. What platform would you recommend building this site on? I currently use Miva Merchant for an ecommerce platform, however this new site will not require the customization that Miva provides, and will also not need to have ecommerce capabilities. This will strictly be an informational site for prospective and current clients.
Web Design | | djlittman0 -
Site structure and blog tags for local with five locations
I have a client who has five locations. Their current web site was structured very well for the pre-penguin and Panda world. However it does not seem to do as well after these changes. I believe it would serve them both with their customers as well as on Google if they localized the site for each location. Currently all the content on the site if focused on one location that is in the largest metro. On the content side we have a plan to produce local content and blogs for each location. My questions are how to go about structuring the site map and blogs to provide the most local juice. I was also wondering how to properly mark up a site with a main trunk and five local branches. I am also trying to figure out how to structure the tags on the blog. On the site map itself I was planning on maintaining all the content as well as the older blogs in the main trunk of the web site. Under this trunk there is a locations page that currently goes to five pages that simply have an address as well as a bulletin board of upcoming events. The blog is directly off the main page with no tie to any location. Here are my thoughts on what I think we should do: I believe we should create a mini web site starting at the location page that has specific content and navigation related to each location. That the content should focus on the specifics of that area and what would serve that clientele the best. We should add to each branch location based on the key words and competition in that area. The blog off the main web site should continue to house the general categories that are already there as well as any other general posts. I think we should add a link to each store page with a location specific blog in each mini location site. Each mini location site should have it's own blog with specific blogs targeted towards the local market. This local blog would also feed in the general blogs from the "trunk" as they are posted. Relating back to my original questions: is what I outlined the right approach or is there a more effective way to do this? Is there any special mark up I should do to tell the directories what to do? How do I structure the tags for the blog? I was thinking of a structure like this: General blog/category/subject under the main structure : local blog/category/subject Any ideas of input on this? Ron
Web Design | | Ron_McCabe1 -
Given the lastest Google update, should I rewrite my Flash site or try to present an alternative HTML/CSS site?
I have a site that was created using Flash. The reasoning behind this was, at the time, that I didn't care if the site ranked or not (portfolio site). Now I would like to drive traffic to the site from SE's. Given the Penguin update, should I rewrite my Flash site in HTML/CSS or present an alternative site for bots and browsers that don't support Flash? My concern is that by presenting an alternative site to bots and non Flash supporting browsers that the SE's will see potentially see this as cloaking. Thoughts and advice would be much appreciated.
Web Design | | mj7750 -
I NEED ADVICE: Need Web Software for customers to access backend
I have a prospect in the credit repair industry. Does anybody know of some software where the clients can log into their own accounts to see the progress? The feature I am looking for is like a Real Estate website where the brokers can create their own accounts and upload their own properties.
Web Design | | Francisco_Meza0 -
Setup of three major retail sites.. need advice.
I recently have taken a new position responsible for three large national retail sites which are all owned by one parent organization. Through a series of acquisitions, these three major brands have been brought under one umbrella and a brand consolidation is likely not to happen within the next 2-4 years. I have a number of questions I’m hoping to get some feedback on, but first a little more background is necessary. A year ago (before my time) the three sites were over-hauled, but were designed to use one common custom CMS and all of the navigation and nearly all the content is the same (with some exceptions, such as tags, url, etc.). All of the brands have identical products and services; however, each one services a different demographic in the US. The design was intended for ease of management, but is terrible for seo. Additionally, without the geographic reference, they all compete for the same keywords. They have now begun a very large ecommerce project utilizing an ATG platform. The initial direction is to use one platform for all three brands, but keep them on separate domains and with the use of basic switching, replace nominal content such as logos and references of the brands for each of the domains. I’m concerned with this approach and would like to hear your feedback.. When optimizing a page for one keyword set, are they likely to be filtered due to dup content? The argument that management has is that all three current sites rank very well for one keyword on all three sites. They feel it won’t be an issue due to this. One option, that is currently still available, is to tri-band one ecommerce site, but it would have to be on an entirely new domain. The other three domains are very well established and are PR6s. Management, and even I, is afraid to abandon these other domains, but having a single domain would allow us to have unique content and really leverage all efforts to one domain. Thoughts? Any knowledge or thoughts what kind of impact having three domains on one ATG platform will be? Thanks much! John If you feel it will help, please message me and I can share the urls... Also, how would you handle a company blog in this case?
Web Design | | kavaliauskas0