Can't generate a sitemap with all my pages

[Banknotes]

I am trying to generate a site map for my site nationalcurrencyvalues.com but all the tools I have tried don't get all my 70000 html pages...   I have found that the one at check-domains.com crawls all my pages but when it writes the xml file most of them are gone... seemingly randomly.

I have used this same site before and it worked without a problem.  Can anyone help me understand why this is or point me to a utility that will map all of the pages?

Kindly,

Greg

[Banknotes]

Thank you all for the responses... I found them all helpful.  I will look into creating my own sitemap with the IIS tool.

I can't help the 70k pages but the URLS are totally static.  I guess I can make a site map for all the aspx pages and then other one for all the lowest level .html pages.

Thanks everyone!

[dohertyjf]

I definitely agree with Logan. The max for an XML sitemap for Search Console is 50,000 URLs, so you won't be able to fit all of yours into one.

That being the case, divide them into different sitemaps by category or type, then list all of those in one directory sitemap and submit that. Now you can see indexation by page type on your website.

Finally, I have to ask why you are doing this with a third party tool and creating a static sitemap as opposed to creating a dynamic one that can update automatically when you publish new content? If your site is static and you're not creating new pages, then your approach might be ok, but otherwise I'd recommend investigating how you build a dynamic XML sitemap that updates with new content.

Cheers!

[Tylerj]

Looking at your site how sure are you that you need 70,000 pages?

For the sitemap I would stop trying to use a website and do it yourself. It looks like you are running IIS. They have a sitemap generator that you can install on a server easily and run it there. It looks like you have GoDaddy, they catch a lot of crap but I have always found their technical support to be top notch. If you can't figure out how to do it on the server I would give them a call.

[LoganRay]

Greg,

Have you tried creating multiple XML sitemaps by section of the site, like by folder or by product detail pages? 70,000 is a huge amount of URLs and even if you could get them all on one sitemap, I wouldn't recommend it. Nesting sitemaps into an index sitemap can help Google understand your site structure and make it easier for you to troubleshoot indexing problems should they arise.