Technical Question about tools available in market
-
Hi,
I am looking for a tool most probably web based tool like opensiteexplorer / majestic seo that gives me the list of URL
For example, on google we can do site:seomoz.org , and it's saying About 115,000 results.
I need to get list of those 115,000 URLS in any file whether it's csv or any other.
anybody care to share ?
-
SEOmoz use to have this option in the past days but recently when i checked its gone... but while research to answer this question i found this http://www.martinhurford.com/serp-downloader-bookmarklet.html
Check this out and see if it is powerful!
-
I agree that Screaming Frog is the best. http://www.screamingfrog.co.uk/seo-spider/
You can get a full list of URLs including data on the following:
- Errors – Client & server errors (No responses, 4XX, 5XX)
- Redirects – (3XX, permanent or temporary)
- External Links – All followed links and their subsequent status codes
- URI Issues – Non ASCII characters, underscores, uppercase characters, dynamic uris, long over 115 characters
- Duplicate Pages – Hash value / MD5checksums lookup for pages with duplicate content
- Page Title – Missing, duplicate, over 70 characters, same as h1, multiple
- Meta Description – Missing, duplicate, over 156 characters, multiple
- Meta Keywords – Mainly for reference as it’s only (barely) used by Yahoo.
- H1 – Missing, duplicate, over 70 characters, multiple
- H2 – Missing, duplicate, over 70 characters, multiple
- Meta Robots – Index, noindex, follow, nofollow, noarchive, nosnippet, noodp, noydir etc
- Meta Refresh – Including target page and time delay
- Canonical link element & canonical HTTP headers
- X-Robots-Tag
- File Size
- Page Depth Level
- Inlinks – All pages linking to a URI
- Outlinks – All pages a URI links out to
- Anchor Text – All link text. Alt text from images with links
- Follow & Nofollow – At link level (true/false)
- Images – All URIs with the image link & all images from a given page. Images over 100kb, missing alt text, alt text over 100 characters
Thanks
-
ScreamingFrog the best
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Recommend me best tools for live ranking
Hello, guys, I have a question, that which tools are best for ranking because MOZ update ranking after a week and I want a live ranking of my website leatherbaba.com Kindly recommend me best tools for SEO.Many Thanks!
Moz Pro | | fahaffff0 -
Mac Alternatives for Netpeak & SEO Tools For Excel?
Does anybody know of any mac alternatives for Netpeak & SEO tools for excel? I haven't been able to find any. I just need something to pull PA & DA quickly for a list of domains and URLs. Will I just have to create something custom with the Moz API?
Moz Pro | | kking41200 -
Is there an external tool to check for Link Balance profile (anchor text)?
Hi, Regarding the topic of Link Balance (anchor text from external sites). Is there an external tool you can point to your site or an individual URL that can give you the link balance (branded terms, exact match etc). This article is great:
Moz Pro | | STL
http://moz.com/blog/anchor-text-distribution-avoiding-over-optimization But it's a lot of work to do for individual pages (of which we have many). Just trying to see if there's a tool out there (Moz or otherwise), that can report on such balance on a page-by-page basis (paste in URL, hit 'Go'). Thanks.
Rich Talbot0 -
Tool to find compeitor keyword overlap?
I want to know which competitors rank for the same things I do. Is there a tool that can give me this info?
Moz Pro | | ShearingsGroup0 -
Annotations in Moz tools?
Beginner question, I know, but is there a way to add an annotation or event to the Moz tools, as I can in Google Analytics? I'd like to mark when a change was made. Thanks.
Moz Pro | | KelloggMoz0 -
I can't submit a private question
I'm trying to submit a private question but I get an error saying: We're sorry, but something went wrong. We've been notified about this issue and we'll take a look at it shortly. Cornel
Moz Pro | | Cornel_Ilea0 -
Competitive Domain Analysis Question
When looking at the Competitive Domain Analysis I noticed that I am the only one amongst my competitors that does not have a link from DMOZ. The problem is, I do have a link from them. When you search for my site on dmoz.org you can find my site and it has been that way for quite a while. Anyone know any possible reasons it may be doing this?
Moz Pro | | ClaytonKendall0 -
Is there a tool to upload multiple URLs and gather statistics and page rank?
I was wondering if there is a tool out there where you can compile a list of URL resources, upload them in a CSV and run a report to gather and index each individual page. Does anyone know of a tool that can do this or do we need to create one?
Moz Pro | | Brother220