Sitemap - What are the recommendations on the number of links
-
Hi,
I have a sitemap(s) which is very large(.i.e. 60000) links, is it recommended to have so many links and how come when I do a site search(site:mydomain) the number of links are less than on my site map?
-
Sitemaps cannot (should not) contain more than 50,000 URLs: https://www.sitemaps.org/faq.html#faq_sitemap_size
I'd recommend you instead create a sitemap index to house multiple sitemap files. Keep in mind you will need to separate the URLs in them in order to represent all 60K URLs you have in your existing sitemap.
Separately, EGOL makes excellent points: sitemaps aren't the only way to get pages indexed. It's entirely possible that you do not have sufficient internal links that aid crawlers' discovery of your content: https://moz.com/learn/seo/internal-link
You may also have directives (e.g. noindex) on certain pages or in your robots.txt that prevents crawlers from crawling and indexing certain parts of your site. It may be time for a technical audit: https://www.distilled.net/technical-seo-audit-checklist/
-
how come when I do a site search(site:mydomain) the number of links are less than on my site map?
There are many causes of poor indexing....
-- if your site does not have very many links, it is possible that Google does not crawl it deeply and completely, and might even forget many of your pages between crawls
-- poor indexing can be caused by a poor site structure, where you have category pages that link to subcategory pages which link to deep pages.... AND, you have lots of internal and external links hitting these category pages to force crawlers deep into your site - where they must chew their way out through a lot of pages
-- also, consider your content... is it unique, substantive, not copy-pasted from other websites... with such problems, Google can choose to ignore your pages
is it recommended to have so many links
That is a lot of links. I would consider two site maps, each with half of our pages, that will get more crawling deep into your site.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can one back-link fluctuates ranking of website with thousands of back-links?
It happend to our website. We have seen major ranking fluctuations for our website because of one back-link. What kind of links those can be? Why Google is not stopping them even though they claim that such back-links will be taken care of?
Intermediate & Advanced SEO | | vtmoz0 -
Internal nofollow links
Hello, We have a blog and at the end each blog post (and from the sidebar) we link to one main product page (tagged with a particular query string). Now Google will see from every blog post all of these internal links pointing back to this page. Do you think this would cause a problem and that these links should be nofollowed? I think Google will kind of detect that these is kind of a "navigation" as the code will be the same across all webpages. Most of all, doing them nofollow I think it is worse because it may trigger some sort of pagerank sculpting algo filter, if it still exists. Thanks, Conrad
Intermediate & Advanced SEO | | conalt0 -
Should I bother with a Video Sitemap?
Morning all, I've started a pretty aggressive Video content push in recent weeks. All our videos are on our YouTube channel. I decided to go with hosting the videos on YouTube based on my research on moz.com, especially considering the potential reach of the content on YouTube. What I'm finding is that the YouTube channel is doing great. We've hit 200 subscribers and 15K views in a little under a month. Wayyyy more than I could have ever hoped for. But the blog posts on our website are getting minimal traffic and no search visibility. That doesn't necessarily bother me, since the intention of our marketing campaign is to use YouTube to drive traffic to our website. So I guess my question is really more to do with optimizing the site with Video Sitemaps and best practices for Google Webmaster Tools. Right now we have YouTube videos embedded on blog posts like this one that have a time-stamp. But I've been working to create Gallery-style pages (no time-stamp) which would have multiple YouTube videos embedded on them like this one. These make it easier for visitors to watch multiple videos without needing to skip around to multiple blog posts. The challenge I'm running into is that when I go to submit a Video Sitemap to GWT I get an error saying that I have duplicate page content within the video sitemap. I've used several WP plugins to do this. It seems that when there is a video embedded on multiple URLs (pages + posts) the plugins will ignore the posts and only add the pages to the video sitemap. Here is my regular Sitemap Here is my video Sitemap I've attached a screenshot of my current Yoast Video SEO config if that's useful for reference. Does anyone have experience with using multiple sitemaps in GWT? I'm starting to think that maybe I shouldn't even bother with a video sitemap. Maybe those gallery-style pages should just go in the regular sitemap? Any thoughts or advice would be highly appreciated! Thanks llQfydA
Intermediate & Advanced SEO | | TMHoward860 -
Internal links question
I've read that Google frowns upon large numbers of internal links. We're building a site that helps users browse a list of shows via dozens of genres. If the genres are expose, say, as a pulldown menu as opposed to a list of static links, and selecting the pulldown option filters the list of shows, would those genres count against our internal links count?
Intermediate & Advanced SEO | | TheaterMania0 -
Custom sitemap or sitemap generator tool
I have recently launched a website which is using a free sitemap generator (http://web-site-map.com/). It's a large travel agency site (www.yougoadventure.com) with predominantly dynamically generated content - users can add their products as and when and be listed automatically. The guy doing the programming for the site says the sitemap generator is not up to the job and that I should be ranking far better for certain search terms than the site is now. He reckons it doesn't provide lastmod info and the sitemap should be submitted every time a new directory is added or change made. He seems to think that I need to spend £400-£500 for him to custom build a site map. Surely there's a cheaper option out there for a sitemap that can be generated daily or 'ping' google every-time an addition to the site is made or product added? Sorry for the non tech speak - Ive got my web designer telling one thing and the programmer another so im just left trawling through Q&As. Thanks
Intermediate & Advanced SEO | | Curran0 -
Internal Javascript Links
Hi, We have a client who has internal links pointing to some relatively new pages that we asked them to implement. The problem is that instead of using standard HTML links, their developers have used javascript - e.g. javascript:GoTo... The new pages have links from the homepage (among others) and have been live for about 3-4 weeks now - yet are still to be indexed by Google, Bing & Yahoo. Is it possibe that Javascript links are making them difficult to be found? Thanks in advance for any tips.
Intermediate & Advanced SEO | | jasarrow0 -
Best tools for exploring links?
and not just every single link, but ones you know that Google is actually indexing. I find seomoz to be super easy, but there is no way to distinguish links that are actually counting "juice", or am i missing something. What about majesticseo - any other similar tools you use when trying to find linking sites that pass juice?
Intermediate & Advanced SEO | | imageworks-2612900 -
Too many links!
Hi, I'm running a wordpress blog (modhop.com) and am getting the "too many links" on almost all of my pages. It appears that in addition to basic site navigation I have plug-ins that create invisible links that are counted in the crawl...at least that's my guess. Is there a good way to control this in wordpress? A nofollow in the .htaccess? A plug-in that does this? (I'm sort of at novice-plus level here so the simplest solution is ideal.) Thanks! Jake modhop.com
Intermediate & Advanced SEO | | modhop0