Site map creator
-
I have a large website with about 1300 pages. I can't find a good sitemap creator that will crawl the whole site and spit out the xml file. Any ideas or suggestions for good services? Also, a site this large, should I consider mutiple site maps?
-
Hi,
Go indeed with ScreamingFrog if you're not on WordPress. If you are running WordPress go with a SEO Plugin like the one from Yoast. That will make sure new pages will automatically get added to the sitemap instead of having to recrawl your site very often.
A sitemap can contain up to 50.000 URLs. So for now with only 1300 URLs I wouldn't worry about the size of the sitemap or having multiple sitemaps.
-
Hello there,
Are you looking for a free sitemap creator? I dont know any that crawls more of 500 pages.
Screaming frog does a killing job. Dont know how many pages crawls in the free version. I totally recommend it.
And there is no problem with that quantity of pages in one sitemap.
Cheers.
GR.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How best to structure wordpress site.
I need help on how to structure my wordpress site to avoid duplicate content issues. Basically I have a main category page for each of my targeted keywords (about 12). From each of those though I want to create a category for each county in the uk and then about 15 towns within each county. This means I'm creating a LOT of categories. Eg: /plumbers/lincolnshire/lincoln x 15 other counties and towns /local-plumbers/cambridgeshire/cambridge x 15 other counties and towns (I have about 12 main keywords I'm going after) I'm basically creating a category for every town in the UK going after long tail keywords. What is the best way to manage this in wordpress? Advice from another question I posted on here is to write a unique category description for each one as the posts in each category are almost identical. The other problem here is I'm ending up with hundreds of links on a page. (They can't all be seen by the user as I'm using a drop down menu plugin). Any advice appreciated.
Intermediate & Advanced SEO | | SamCUK0 -
What's the best way to manage content that is shared on two sites and keep both sites in search results?
I manage two sites that share some content. Currently we do not use a cross-domain canonical URL and allow both sites to be fully indexed. For business reasons, we want both sites to appear in results and need both to accumulate PR and other SEO/Social metrics. How can I manage the threat of duplicate content and still make sure business needs are met?
Intermediate & Advanced SEO | | BostonWright0 -
How to use Video sharing sites for SEO ?
How to use Video sharing sites for SEO ? There are many video sharing sites like Youtube,vimeo,flickr ect .How to use them properly for boosting ranking of a web site using videos.as i can see only youtube and vimeo can add url of web site in description area so how to use videos on others sites .
Intermediate & Advanced SEO | | innofidelity0 -
Acquisition of a new site in the same field.
Hello, I work with SEO for a company that just bought another in the same field. What is better to do? Just a 301 domain? Make 301 per page for a related page (more than 10,000 URLs, i'am afraid that this may be interpreted as blackhat ) or make crossdomain canonical tag urls related to (I believe this is not good, because the pages are not fully equal). thank's
Intermediate & Advanced SEO | | j0a0vargas0 -
My Job Site is having Indexing Issues
I have 2 job sites that I am managing and working on. One of the sites has a great deal of job vacancies and expired job pages that have been indexed. This one below: http:// job search.cctc .com/cctc Jobsearch/expandedjobsearch.do This job site does not have any job pages index: http://www.cross countryallied. com/ctAlliedWebSite/ travel-nurse-jobs/job-search.jsp Why and what can I do to get the dynamic pages index and ranking? Any help tips would be much appreciated. Thanks
Intermediate & Advanced SEO | | Melia0 -
Targetting site in 3 countries
I have read the seomoz post at - http://www.seomoz.org/blog/international-seo-where-to-host-and-how-to-target-whiteboard-friday before asking the question We recieved a query from one of our client regarding targetting his site in 3 different countries namely - US,UK and Australia. Specifically, he has asked us- 1. Whether i should buy ccTLD like - www.example.co.uk www.example.com.au www.example.com and write unique content for each of the above. or 2. or go for subfolder approach www.example.com/UK www.example.com/AU will it affect SEO if the subfolders are in CAPS. Would like to have advice of moz community on what advice will be the best. Thanks
Intermediate & Advanced SEO | | seoug_20050 -
Penalties for site going down often?
I have a client with a site that ranks for some very competitive terms who consistently has server issues and the site goes down for a day at a time. Each time this happens his site seems to drop in site wide rankings and then stay there for months without ever fully recovering. Only part of the rankings are usually recovered. Has anyone else seen this trend? Is it something Google keeps on record without fully removing any penalty addressed?
Intermediate & Advanced SEO | | iAnalyst.com0 -
Duplicate Listings on Google Maps
About 3 weeks ago google created a duplicate listing for our law firm on google maps. In building links I have tried very hard to ensure that our address and company name was always listed identically. Our correct firm name and address is Feldman Feldman & Associates, PC 2221 Camino Del Rio South, Suite 201 inevitably somehow the new listing stated Camino Del Rio S, Ste 201 All of our reviews moved over to this new profile, I claimed it, changed it to make it the same reported it to Google. Google merged them. Now Google has created another profile this time the firm name and address matches ours exactly (South and Suite both spelled out), but all of the reviews have moved over except for the most recent one(s). I have claimed it again and reported it to google, changed the address. Google then created another listing. Our page rank for keywords has been hurt by this. any idea why this keeps happening suggestions? Here are the two pages. This is our original listing http://maps.google.com/maps/place?hl=en&cid=468564492130231259 This is the new one google self created that stole all our reviews, but is ranked very poorly for the keyword searches. http://maps.google.com/maps/place?&cid=468564492130231259
Intermediate & Advanced SEO | | jfeld2220