Sitemap - What are the recommendations on the number of links
-
Hi,
I have a sitemap(s) which is very large(.i.e. 60000) links, is it recommended to have so many links and how come when I do a site search(site:mydomain) the number of links are less than on my site map?
-
Sitemaps cannot (should not) contain more than 50,000 URLs: https://www.sitemaps.org/faq.html#faq_sitemap_size
I'd recommend you instead create a sitemap index to house multiple sitemap files. Keep in mind you will need to separate the URLs in them in order to represent all 60K URLs you have in your existing sitemap.
Separately, EGOL makes excellent points: sitemaps aren't the only way to get pages indexed. It's entirely possible that you do not have sufficient internal links that aid crawlers' discovery of your content: https://moz.com/learn/seo/internal-link
You may also have directives (e.g. noindex) on certain pages or in your robots.txt that prevents crawlers from crawling and indexing certain parts of your site. It may be time for a technical audit: https://www.distilled.net/technical-seo-audit-checklist/
-
how come when I do a site search(site:mydomain) the number of links are less than on my site map?
There are many causes of poor indexing....
-- if your site does not have very many links, it is possible that Google does not crawl it deeply and completely, and might even forget many of your pages between crawls
-- poor indexing can be caused by a poor site structure, where you have category pages that link to subcategory pages which link to deep pages.... AND, you have lots of internal and external links hitting these category pages to force crawlers deep into your site - where they must chew their way out through a lot of pages
-- also, consider your content... is it unique, substantive, not copy-pasted from other websites... with such problems, Google can choose to ignore your pages
is it recommended to have so many links
That is a lot of links. I would consider two site maps, each with half of our pages, that will get more crawling deep into your site.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Add versioning to an xml sitemap?
Is there a way to add versioning to an xml sitemap? Something like <version>x.x</version> outside of the <urlset>?</urlset> I've looked at a bunch of sitemaps for various sites and don't see anyone adding versioning information, but it seems like it would be a common issue - I can't believe someone hasn't come up with some way to do it.
Intermediate & Advanced SEO | | ATT_SEO0 -
Affiliate Links Dilemma
Hello everyone. Our e-commerce website virtualsheetmusic.com has several hundreds affiliate incoming links, and many of them are "follow" links. I thought to redirect all incoming affiliate links to a "intermediate" page excluded by the robots.txt file in order to avoid any possible "commercial links" penalty from Google, but I now face a dilemma... most of our best referral links are affiliate links, by excluding those links from our back link profile could give us a big hit in terms of rankings. How would you solve this dilemma? What would you suggest doing in this sort of cases?
Intermediate & Advanced SEO | | fablau0 -
301 Externally Linked, But Non-Producing Pages, To Productive Pages Needing Links?
I'm working on a site that has some non-productive pages without much of an upside potential, but that are linked-to externally. The site also has some productive pages, light in external links, in a somewhat related topic. What do you think of 301ing the non-productive pages with links to the productive pages without links in order to give them more external link love? Would it make much of a difference? Thanks... Darcy
Intermediate & Advanced SEO | | 945010 -
Site wide links - should they be nofollow or followed links
Hi We have a retail site and a blog that goes along with the site. The blog is very popular and the MD wanted a link from the blog back to the main retail site. However as this is a site wide link on the blog, am I right in thinking this really should be no follow link. The link is at the top of every page. Thanks in advance for any help
Intermediate & Advanced SEO | | Andy-Halliday0 -
'Nofollow' footer links from another site, are they 'bad' links?
Hi everyone,
Intermediate & Advanced SEO | | romanbond
one of my sites has about 1000 'nofollow' links from the footer of another of my sites. Are these in any way hurtful? Any help appreciated..0 -
Site wide links removal
A website of mine has about 4,000 backlinks of which 2,500 of them are coming from one website to the homepage and about 6 internal pages. These have been built up over about 5 years, mainly via article posts. The site was recently hit via penguin 2.0 but has only had natural links built so i'm wondering if the sitewide links are in fact the issue? The website linking to mine is an authority source within its niche but the concern is the amount of backlinks coming from this one site and if it may now be seen as having a negative impact. When ive reviewed the links from this one site via a backlink removal tool about 80% seem fine and suggestions are to remove about 20% of the backlinks. Would you keep all the sitewide backlinks or remove them?
Intermediate & Advanced SEO | | jazavide
Have you come across a similar situation and how did it affect ranking/traffic?0 -
Link masking in WordPress
in Wordpress, I want to block Google from crawling my site using the primary navigation. I want to use anchor text links in the body and custom menus in the sidebar to make maximum benefit of the "first link counts" rule. In short, I want to obfuscate all of the links in my primary navigation without using the dreaded nofollow. I do not want to block other links to the pages - body text, custom menus, etc. . This would be site wide. I'd rather not use Ajax or any type of programming unless it's part of a plugin. Can anyone make a simple, Google-friendly suggestion?
Intermediate & Advanced SEO | | CsmBill0 -
If google ignores links from "spammy" link directories ...
Then why does SEO moz have this list: http://www.seomoz.org/dp/seo-directory ?? Included in that list are some pretty spammy looking sites such as: <colgroup><col width="345"></colgroup>
Intermediate & Advanced SEO | | adriandg
| http://www.site-sift.com/ |
| http://www.2yi.net/ |
| http://www.sevenseek.com/ |
| http://greenstalk.com/ |
| http://anthonyparsons.com/ |
| http://www.rakcha.com/ |
| http://www.goguides.org/ |
| http://gosearchbusiness.com/ |
| http://funender.com/free_link_directory/ |
| http://www.joeant.com/ |
| http://www.browse8.com/ |
| http://linkopedia.com/ |
| http://kwika.org/ |
| http://tygo.com/ |
| http://netzoning.com/ |
| http://goongee.com/ |
| http://bigall.com/ |
| http://www.incrawler.com/ |
| http://rubberstamped.org/ |
| http://lookforth.com/ |
| http://worldsiteindex.com/ |
| http://linksgiving.com/ |
| http://azoos.com/ |
| http://www.uncoverthenet.com/ |
| http://ewilla.com/ |0