Sitemap - What are the recommendations on the number of links
-
Hi,
I have a sitemap(s) which is very large(.i.e. 60000) links, is it recommended to have so many links and how come when I do a site search(site:mydomain) the number of links are less than on my site map?
-
Sitemaps cannot (should not) contain more than 50,000 URLs: https://www.sitemaps.org/faq.html#faq_sitemap_size
I'd recommend you instead create a sitemap index to house multiple sitemap files. Keep in mind you will need to separate the URLs in them in order to represent all 60K URLs you have in your existing sitemap.
Separately, EGOL makes excellent points: sitemaps aren't the only way to get pages indexed. It's entirely possible that you do not have sufficient internal links that aid crawlers' discovery of your content: https://moz.com/learn/seo/internal-link
You may also have directives (e.g. noindex) on certain pages or in your robots.txt that prevents crawlers from crawling and indexing certain parts of your site. It may be time for a technical audit: https://www.distilled.net/technical-seo-audit-checklist/
-
how come when I do a site search(site:mydomain) the number of links are less than on my site map?
There are many causes of poor indexing....
-- if your site does not have very many links, it is possible that Google does not crawl it deeply and completely, and might even forget many of your pages between crawls
-- poor indexing can be caused by a poor site structure, where you have category pages that link to subcategory pages which link to deep pages.... AND, you have lots of internal and external links hitting these category pages to force crawlers deep into your site - where they must chew their way out through a lot of pages
-- also, consider your content... is it unique, substantive, not copy-pasted from other websites... with such problems, Google can choose to ignore your pages
is it recommended to have so many links
That is a lot of links. I would consider two site maps, each with half of our pages, that will get more crawling deep into your site.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Any idea why Google Search Console stopped showing "Internal Links" and "Links to your site"
Our default eCommerce property (https://www.pure-elegance.com) used to show several dozen External Links and several thousand Internal Links on Google Search Console. As of this Friday both those links are showing "No Data Available". I checked other related properties (https://pure-elegance.com, http:pure-elegance.com and http://www.pure-elegance.com) and all of them are showing the same. Our other statistics (like Search Analytics etc.) remain unchanged. Any idea what might have caused this and how to resolve this?
Intermediate & Advanced SEO | | SudipG0 -
Questions About Link Detox
Greetings: In April of 2014 an SEO firm ran a link removal campaign (identified spammy links and uploaded a disavow). The overall campaign was ineffective and MOZ domain rank has fallen to 24 from about 30 in the last year and traffic is 20% lower. I purchased a basic package for Link Detox and ran a report today (see enclosed) to see if toxic links could be contributing to our mediocre rankings. As a novice I have a few questions for you regarding this the use of Link Detox: -We scored a domain wide detox risk of 1,723. The site has referring root domains with 7113 links to our site. 121 links were classified as high audit priority. 56 as medium audit priority. 221 links were previously disavowed and we uploaded a spreadsheet containing the names of the previously disavowed links. We had LinkDetox include an analysis of no-follow links as they recommend this. Is our score really bad? If we remove the questionable links should we see some benefit in ranking? -Some of the links we disavowed last year are still linking to our site. Is it worthwhile to include those links again in our new disavow file? -Prior to filing a disavow we will request that Webmaster remove offending links. LinkDetox offers a package called Superhero for $469.00 that automates the process. Does this package effectively help with the entire process of writing and tracking the removal requests? Do you know of any other good alternatives? -A feature called "Boost" is included in the LinkDetox Super Hero package. It is suppose to expedite Google's processing of the disavow file. I was told by the staff at Link Detox that with Boost Google will process the disavow within a week. Do you have any idea if this claim is valid??? It would be great if it were true. -We never experienced any manual penalty from Google. Will uploading a disavow help us under the circumstances? Thanks for your feedback, I really appreciate it!!! Alan p2S6H7l
Intermediate & Advanced SEO | | Kingalan10 -
'Nofollow' footer links from another site, are they 'bad' links?
Hi everyone,
Intermediate & Advanced SEO | | romanbond
one of my sites has about 1000 'nofollow' links from the footer of another of my sites. Are these in any way hurtful? Any help appreciated..0 -
How hard would it be to take a well-linked site, completely change the subject matter & still retain link authority?
So, this would be taking a domain with a domain authority of 50 (200 root domains, 3500 total links) and, for fictitious example, going from a subject matter like "Online Deals" to "The History Of Dentistry"... just totally unrelated new subject for the old/re-purposed domain. The old content goes away entirely. The domain name itself is a super vague .com name and has no exact match to anything either way. I'm wondering, if the DNS changed to different servers, it went from 1000 pages to a blog, ownership/contacts stayed the same, the missing pages were 301'd to the homepage, how would that fare in Google for the new homepage focus and over what time frame? Assume the new terms are a reasonable match to the old domain authority and compete U.S.-wide... not local or international. Bonus points for answers from folks who have actually done this. Thanks... Darcy
Intermediate & Advanced SEO | | 945010 -
PR links
Its seems that at lot of or competitors are using PR site to place articles with links. They are using the same article across many sites with the same anchor text link - But they seem to be doing very well in the rankings.... I have steered away from this type of linking as I assumed Google wouldn't be keen on this type of activity but I seem to be wrong.... Any views on this?
Intermediate & Advanced SEO | | jj34340 -
Unnatural Links Removal - are GWMT links enough?
Hi, When working on unnatural links penalty, is removing and disavowing links shown on the GWMT enough or should the list be broaden to include OSE and Majestic etc.? Thanks
Intermediate & Advanced SEO | | BeytzNet0 -
Site Wide Link Situation
Hi- We have clients who are using an e-commerce cart that sits on a separate domain that appears to be providing site wide links to our clients websites. Therefore, would you recommend disallowing the bots to crawl/index these via a robots.txt file, a no follow meta tag on the specific pages the shopping cart links are implemented on or implement no follow links on every shopping cart link? Thanks!
Intermediate & Advanced SEO | | RezStream80 -
How often to resubmit updated sitemap?
Hello Forum, I am working with an eCommerce website (not huge, a site with ~300 products and a blog that is updated every few days) that occasionally adds new products and may make a few large edits per week, if that. Our CMS can automatically generate and submit our sitemap. Over what time interval is should we do this for? Daily, weekly, monthly, etc? Thanks!
Intermediate & Advanced SEO | | pano0