I need an XML sitemap expert for 5 minutes!
-
Hi all!
I'm hoping that someone with a lot of experience with XML sitemaps can help me out here...
When submitting my sitemap in Google Webmaster Tools, these are the results:
2,414,714 Submitted
34,721 IndexedAnd there's also tonnes of warnings.
Would anyone be able to take a quick look at these sitemaps to perhaps advise me on what's going wrong there? These do not load without the www, not sure if this is an issue?
http://www.eumom.ie/sitemap.xml
http://www.eumom.ie/sitemap.xml.gzThanks everyone in advance!!
Gavin
-
Few rules about sitemaps;
-
You should only include in them pages you also want crawled and indexed
-
They should not contain URLs with 404s or blocked by robots.txt
My guess is there are too many URLs in the sitemaps, since I'd guess the website is not over 2 million actual "real" pages,
Also, I randomly clicked on a URL in one of the sitemaps and it 404'd;
http://www.eumom.ie/forums/topic/oakhill-school-leopardstown-/
This is probably causing a lot of the errors you see. It's honestly not a 5 minute fix - but if it were my site, I would be using the Yoast SEO plugin and using the sitemap feature within Yoast. It makes it very easy to include / exclude certain pages and updated automatically etc.
I think there must be a way to tell your plugin what to include / exclude from the sitemap but I don't have as much experience with it.
But generally - only include pages you want crawled and indexed. Don't include pages that 404.
-
-
Hi all,
Many thanks for your input so far, much appreciated!
The sitemaps that you are seeing actually were generated using that plugin you mentioned. Formatting-wise, do you see anything wrong with the sitemaps?
Thanks!!
Gavin -
I couldn't agree more altecdesign!
http://wordpress.org/plugins/google-sitemap-generator/ all the way!
-
That XML sitemap you linked too is formatted in an odd way. I noticed the site you are generating the xml sitemap for is based in wordpress. There is a really solid sitemap plugin you could use to generate your XML and submit to google instead of the current plugin you are using: http://wordpress.org/plugins/google-sitemap-generator/
I've used that plugnin numerous times and submitted sitemaps to google with no errors. Hopefully that helps you out.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
URL Indexed But Not Submitted to Sitemap
Hi guys, In Google's webmaster tool it says that the URL has been indexed but not submitted to the sitemap. Is it necessary that the URL be submitted to the sitemap if it has already been indexed? Appreciate your help with this. Mark
Technical SEO | | marktheshark100 -
Missing xml tag error
Our xml sitemap is divided up in to many smaller xml sitemaps so we have fewer products per sitemap, in order to easily identify errors. A couple of weeks ago, we changed our xml sitemap by reordering some of the products. However, this has left some old xml sitemaps without any data, and they are no longer appearing in our xml sitemap. But, Google is still identifying these sitemaps since they once existed, and they are giving errors since they can't locate them. Should we 404 those xml sitemaps, or is there a better way to handle this?
Technical SEO | | ang0 -
Sitemap Contains Blocked Resources
Hey Mozzers, I have several pages on my website that are for user search purposes only. They sort some products by range and answer some direct search queries users type into the site. They are basically just product collections that are else ware grouped in different ways. As such I didn't wants SERPS getting their hands on them so blocked them in robots so I could add then worry free. However, they automatically get pulled into the sitemap by Magento. This has made Webmaster tools give me a warning that 21 urls in the sitemaps are blocked by robots. Is this terrible SEO wise? Should I have opted to NOINDEX these URLS instead? I was concerned about thin content so really didnt want google crawling them.
Technical SEO | | ATP0 -
Sitemap Question - E-commerce - Magento
Good Morning... I have an ecommerce site running on Magento and the sitemap is automatically generated by Magento based on the categories and sub categories and products. I have recently created new categories that i want to replace the old categories, but they are both in the auto-generated sitemap. The old categories are "active" (as in still exist if you know the URL to type) but not visible (you can't find it just by navigating through the site). The new category pages are active and visible... If i want Google to rank one page (the new category page) and not the old page (old category page) should i remove the old page from the sitemap? Would removing the old page that used to target the same keywords improve my rankings on the newer category page? Sitemap currently contains: www.example.com/oldcategorypage www.example.com/newcategorypage Did I confuse you yet? Any help or guidance is appreciated. Thanks,
Technical SEO | | Prime850 -
Google Sitemap - How Long Does it Take Google To Index?
We have changed our sitemap about 1 month ago and Google is yet to index it. We have run a site: search and we still have many pages indexed but we are wondering how long does it take for google to index our sitemap? The last sitemap we put up had thousands of pages indexed within a fortnight, but for some reason this version is taking way longer. We are also confident that there are no errors in this version. Help!
Technical SEO | | JamesDFA0 -
Have I constructed my robots.txt file correctly for sitemap autodiscovery?
Hi, Here is my sitemap: User-agent: * Sitemap: http://www.bedsite.co.uk/sitemaps/sitemap.xml Directories Disallow: /sendfriend/
Technical SEO | | Bedsite
Disallow: /catalog/product_compare/
Disallow: /media/catalog/product/cache/
Disallow: /checkout/
Disallow: /categories/
Disallow: /blog/index.php/
Disallow: /catalogsearch/result/index/
Disallow: /links.html I'm using Magento and want to make sure I have constructed my robots.txt file correctly with the sitemap autodiscovery? thanks,0 -
Need very urgent advice on Wedsite Migration questions please.
Good afternoon, I am in the middle of re branding my Computer Repair Business that has been established for the past 5 years now and does very well in GOOGLE for all things computer repair search related queries. I have a done tons of research on the Migration process and all elements involved for the past month now and I have been doing SEO for the past 5 years and am quite knowledgeable and very fluent with search engine optimization. I have a bit of a unique situation going on in my particular instance. Not only am I re branding the business and trying to maintain my GOOGLE rankings trying to pull this off at the busiest time of the year (summer months) but I am also going to be physically relocating my business after the busy (Summer Season) from my current location of Wilmington, NC to Charlotte, NC. Yes, I do understand that Winter would have been the best (time) to do all of this massive changing around but, my hand is forced and this is being done out of necessity for monetary survival purposes and I really have no choice in the matter currently! With that said here is my dilemma. I am setting up a SILO Site Architecture using the "Thesis Framework" and WordPress which will be an improvement by 5 fold of what I have in my current well established JOOMLA site that has done very well in GOOGLE Search these past 5 years (all first page results) for anything (Computer Repair) related in Wilmington, NC. So, I am trying run damage control on this situation and I have a number of questions that need a strategic well thought out answer from a different perspective on this matter. 301 Redirect question: I want to include my geo targeted location in my URL String as it has served me well in the pass however, seeing how I am going to be Physically relocating myself and the business to Charlotte, NC from my current location of Wilmington, NC after the summer months what will I need to take into consideration with this situation in regards to the 301 redirect? _ "If I include my current location (Wilmington NC) in the destination (New Domain) URL string for any given 301 redirect from my existing website to the new website and then physically move to another city 3 months later is this setting myself up for a BIG Failure??"_ Seeing how I have no idea of how this technically works with GOOGLE as far as how long this (migration process) takes to Fully complete where the OLD domain completely drops off and everything is Fully passed over to the New Domain in terms leaving the 301 Re directs in place on the Old Domain Server. How long does this process usually take with GOOGLE? Information that you should know: This is my First Experience doing a Site Migration! The NEW DOMAIN is on a Different Server and IP I will be performing 301 Redirects on a Page to Page Basis! I DO plan on keeping the Old Domain Server Account online for 4 months after the migration process. Both OLD and NEW domains are on HOST GATOR (separate accounts) I am Migrating from JOOMLA to WordPress I am using the Thesis Framework for the new WordPress site (New Domain) I have created and established a well thought out SILO Site Architecture for the (NEW DOMAIN) using Parent and Child Pages in WordPress (not posts) supported by many hours of keyword research for my SILO Themes I am changing My Existing /computer-repair.hml URL Structure to WordPress **/computer-repair/ ** remember.. (using WP - Pages) not posts! I am re branding my Company business from Community Computer Repair to PC Medics On Call I am reducing my on page Content because it is too long in the Tooth for my customer base and although the search engines love it, in it's current state (long winded and well written) it is having a negative effect on the people that actually pay my bills (my customers) but my new Site Hierarchical Structure will rectify a lot of the negative fall out from this change that would otherwise kill me in the search rankings from doing this. In addition to being an proficient SEO I am also a developer and a coder. The New Domain is Currently ALLOWING only my IP Address while I sort this out and until I complete the new site structure and get the content and ON Page done. For the Destination Domain URL Structure, is including my current City (Wilmington NC) going to be an issue with the 301 Redirects seeing how I am moving to Charlotte NC around September? Having the Geo Targeted City in my URL Structure will help offset some of the damage caused by the changes that I need to make. Plus, the URL looks less spammy looking at the examples below when icluding location after the keyword phrase **Example -1 - ** VIRUS REMOVAL SILO With GEO Targeted Location after Keyword http://www.pcmedicsoncall.com/virus-removal-wilmington-nc/malware-removal/ Without - GEO Targeted Location after Keyword http://www.pcmedicsoncall.com/virus-removal/malware-removal ** Example -2 -** COMPUTER REPAIR SILO With GEO Targeted Location after Keyword http://www.pcmedicsoncall.com/computer-repair-wilmington-nc/laptop-repair/ Without - GEO Targeted Location after Keyword http://www.pcmedicsoncall.com/computer-repair/laptop-repair/ As far as the potential problems with icluding the Wilmington NC in the Targeted URL destination for the 301 Redirect and then changing my Actual City location for the business 2 1/2 - 3 months later is this going to be an issue? Pertaining to the 301 redirect question above, how exactly would I handle this if I used Wilmington, NC after the Keyword when I initiate the 301 Redirect to the site? Can I later change this in the OLD Domain .htaccess 3 months later to reflect the Charlotte Location and also do the necessary 301 Redirect in the NEW DOMAIN to reflect the permanent move? I hope I have not confused this any by the way that I am asking? Here is a screen shot of the NEW DOMAIN layout for the Links below and above. NOTE: Currently, ALL Silo Menu Themes have - wilmington-nc/ incorporated after the targeted Keyword http://www.pcmedicsoncall.com/virus-removal-wilmington-nc/malware-removal/ http://www.pcmedicsoncall.com/virus-removal/malware-removal SEOMOZ-PC-MEDICS-ON-CALL-1.jpg SEOMOZ-PC-MEDICS-ON-CALL1.jpg
Technical SEO | | MarshallThompson310 -
My Rankings Keep Going Down - Needs some more ideas on why...
Hi Everyone, I have been working on the website www.PetsSpark.com for a while now. I used to be on the first page for many of my keywords, now I am lucky if i am on the 2nd or 3rd. I stopped my SEO efforts for about 3 months while making changes to the website, its whithin these 3 months that I started dropping from the first page. The biggest thing I notice is the "type" of website now ranking for my main keywords. Mostly Forums, Blogs, or Product Review websites. Take for instance Dog Tear Stain Remover. I used to rank at about #5 for this keyword and now i rank at #20. I'm not sure if my loss of ranking is a combination of things like who Google is letting rank now or if there is something wrong on my website, etc. Can anyone give me a little insight?? Please.... I will also be happy to give more information about what has been going on if needed.
Technical SEO | | DTOSI0