Software/tool for Content Inventory
-
Is there any tool out there which can crawl a section of a website (or whole website) and gives a list of urls by subsections?
I have tried PowerMapper but it only gives visual map, not a list.
Thanks!
-
You can use Moz, Screaming Frog, Sort Site to get results.
-
Xenu mya work http://home.snafu.de/tilman/xenulink.html
-
How about Screaming Frog? - http://www.screamingfrog.co.uk/seo-spider/
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Best practices for publishing sponsored content
Hello, Our website hosts sponsored content from different brands. Should we be listing the sponsor either on the frontend and/or through markup? - Would either way have any sort of an impact? The content itself is already clearly marked as 'sponsored content' but we were more interested in listing the specific sponsor. Also, we’re assuming the outbound links would need to be marked rel="sponsored" but are there any other best practices we should be implementing? Any insight would be appreciated.
On-Page Optimization | | Ben-R
Thank you in advance.
Best,0 -
Impact of keyword/keyphrases density on header/footer
Hi, It might be a stupid question but I prefer to clear things out if it's not a problem: Today I've seen a website where visitors are prompted no less than 5 times per page to "call [their] consultants".
On-Page Optimization | | GhillC
This appears twice on the header, once on the side bar (mouse over pop up), once in the body of most of the pages and once in the footer. So obviously, besides the body of the pages, it appears at least 4 times on every single pages as it's part of the website template. In the past, I never really wondered re the menu, the footer etc as it's usually not hammering the same stuff repeatedly everywhere. Anyway, I then had a look at their blog and, given the average length of their articles, the keyword density around these prompts is about 0.5% to 0.8% for each page. This is huge! So basically my question is as follow: is Google's algorithm smart enough to understand what this is and make abstraction of this "content" to focus on the body of the pages (probably simply focusing on the tags)? Or does it send wrong signals and confuse search engine more than anything else? Reading stuff such as this, I wonder how does it work when this is not navigational or links elements. Thanks,
G Note: I’m purposely not speaking about the UX which is obviously impacted by such a hammering process.0 -
Updating Old Content at Scale - Any Danger from a Google Penalty/Spam Perspective?
We've read a lot about the power of updating old content (making it more relevant for today, finding other ways to add value to it) and republishing (Here I mean changing the publish date from the original publish date to today's date - not publishing on other sites). I'm wondering if there is any danger of doing this at scale (designating a few months out of the year where we don't publish brand-new content but instead focus on taking our old blog posts, updating them, and changing the publish date - ~15 posts/month). We have a huge archive of old posts we believe we can add value to and publish anew to benefit our community/organic traffic visitors. It seems like we could add a lot of value to readers by doing this, but I'm a little worried this might somehow be seen by Google as manipulative/spammy/something that could otherwise get us in trouble. Does anyone have experience doing this or have thoughts on whether this might somehow be dangerous to do? Thanks Moz community!
On-Page Optimization | | paulz9990 -
Webmaster tools content keywords conundrum
I'm working on optimising a phrase that is made up of two words. I've noticed in webmaster tools that the two words are listed separately under the content keywords section. This is fine apart from the two words are listed at very different significance levels, 2 and 18. Drilling deeper it shows that both these words have two variants. The word in position 2 occurs 483 times and the word in 18 occurs 60 times. Sadly the phrase is commercially sensitive as I'd like to just be able to share it here but can't. Should I be looking to include the weaker word more frequently on the site? In anchor text? Or is this normal distribution? Would optimising the weaker word risk the wrath of Panda? moz-question.jpg
On-Page Optimization | | Hannahm240 -
Is it better to create more pages of content or expand on current pages of content?
I am assuming that one way of improving the rankings of current pages will be to create more content on the keywords used... should this be an expansion of the content on current pages I am optimising for a keyword or is it better to keep creating new pages and if we are creating new pages is it best to use an extension of the keyword on the new page – for example if we are optimising one page for ‘does voltage optimisation work’ would it then be worth creating a page optimised for ‘does voltage optimisation work in hotels’ for example and so on? I am guessing maybe both might help, this is just a question I have had from one of my clients.
On-Page Optimization | | TWSI1 -
Should I host my Ecommerce Software in a Subdomain?
We have a single consumer product that we sell through traditional retailers and our website. We have used an ecommerce provider for our website since it's inception 6 years ago. The problem I am facing is website structure. Our domain points to our ecommerce store, and therefore all content pages are created through the ecommerce platform. However, we can't really do a whole lot in terms of structuring URL's or sub domains. Basically, any content created is given an automatically created URL, and can only be fit in a pre-determined category. There is no way to use sub categories. Are we better off for use and site structure to host the ecommerce portion of the site in a subdomain, such as store.domain.com, and then manually creating all of our content and other pages? I look at nest.com as sort of template for that. They too only have a few products, so a full ecommerce design isn't really necessary. Are we better off for SEO and ease of use to handle that separately from our overall website structure? Thanks for any help.
On-Page Optimization | | Rybicki0 -
Duplicate content on ecommerce
We have a website that we created a little over a year ago and have included our core products we have always focused on such as mobility scooters and power wheelchairs. We have been going through and updating product descriptions, adding product reviews that our customers have provided etc in order to improve on our SEO rankings and not be penalized by the Panda update. We were approached by a manufacturer last year about their products and they had close to 10k products that we were able to upload easily into our system. Obviously these all have standard manufacturers descriptions many sites are also using. It will take us forever to go through and change all of these and many products are similar to each other anyway they just vary in size, color etc. Will it help our rankings for our core products to simply go through and delete all of these additional products and categories and just add them one by one with unique descriptions and more detailed information when we have time? We aren't really selling many of them anyway so it won't hurt our sales. I'm clearly new to SEO and any help at all would be greatly appreciated. My main website is www.bestmedicalsuppliesonsale dot com A sample core category that we have changed descriptions for is http://www.bestmedicalsuppliesonsale.com/mobility-scooters-s/36.htm A sample of a category and products we simply uploaded would be at http://www.bestmedicalsuppliesonsale.com/Wound-Care-s/4837.htm I'm open to all suggestions I would just like to see my traffic and obviously sales increase. If there are any other glaring problems please let me know. I need help!
On-Page Optimization | | BestMedical0 -
Webmaster tools Site speed?
Google webmaster tools site performance is reading out at 2.8 and still raising (Going further into the slow pale area) this was in the green fast area for a while until now. Is this something to be worried about?
On-Page Optimization | | BobAnderson0