Tool for scanning the content of the canonical tag
-
Hey All,
question for you. What is your favorite tool/method for scanning a website for specific tags? Specifically (as my situation dictates now) for canonical tags?
I am looking for a tool that is flexible, hopefully free, and highly customizable (for instance, you can specify the tag to look for). I like the concept of using google docs with the import xml feature but as you can only use 50 of those commands at a time it is very limiting (http://www.distilled.co.uk/blog/seo/how-to-build-agile-seo-tools-using-google-docs/).
I do have a campaign set up using the tools which is great! but I need something that returns a response faster and can get data from more than 10,000 links. Our cms unfortunately puts out some odd canonical tags depending on how a page is rendered and I am trying to catch them quickly before it gets indexed and causes problems. Eventually I would also like to be able to scan for other specific tags, hence the customizable concern. If we have to write a vb script to get it into excel I suppose we can do that.
Cheers,
Josh
-
No idea on that one - it's still pretty new. The developers actually chimed in on the post, so you could ask them in the comments.
-
Thanks Dr. Pete and Marcus.
I just finished reading the post. I have looked at Screaming Frog before but was hoping to be able to find a way to do it myself. Just didn't want to plop money down on something that seemed like it should be able to be done using tools I already had. But the software does look good. Any thought on if they will come out with a one time purchase instead of a yearly subscription?
Cheers!
Josh
-
Hey Dr. Pete, Joshua
I was just coming here to say that I had read the Dr. Pete post and this may do the job. It's a paid bit of a software but I will be picking it up later. I have my guys knocking up a canonical checker that will be free for all but that may take a day or so to get perfect.
Let me know if you have a play with Screaming Frog!
Marcus
-
I'm pretty sure that Screaming Frog SEO Spider will do it, but you need the paid version to custom-filter on the canonical tag. I've got a post going up about it tomorrow.
-
Great, really appreciate it! Many thumbs up
-
Hey Josh,
Right, cool. I have got a few jobs to sort out but I am going to have a bash at knocking this up this afternoon. Should be easy enough (he said, damning himself to hours of problems).
Leave it with me for 24 hours.
Marcus
-
Hey Marcus,
thanks for the quick response. That is exactly what I would be looking for. I do have a list of url's and that is also simple enough to get from something like xenu. Would love to work with you on this.
Thanks.
Josh
-
Hey, I am not aware of any such tool, but it should not be too hard to put one together, maybe a useful little tool as well.
If you have all of your pages in spreadsheet or database, it should be easy enough to write a little script that cycles through them.
Start Loop
-
request page
-
parse code to get canonical URL
-
compare page to canonical
-
output problem URLs
End Loop
Slightly over simplified and requires a list of all your URLs but would be willing to help put something like this together, could be useful for all of us, especially for those (like me) that work with a lot of CMS sites.
Cheers
Marcus
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
No more than one canonical url Tag.
I just got the "no more than one canonical url TAG" for this page http://www.vacuumadvisers.com/1/electrolux-ultra-active-deep-clean-bagless-canister-vacuum-cleaner-review. I have no idea how to Fix that. Tried google it but none for Tag in particular. PS. I have changed the Theme recently therefore so did the URL Anyone?
Moz Pro | | bishop230 -
Rel=canonical "redirects" to double links
Our devs have set up rel=canonical on our website. First they used relative links href="/dir1/dir2/dir3" for the page http://www.mysite.com/dir1/dir2/dir3/?detail1=1?detail2=2 meaning that it will redirect to http://www.mysite.com/dir1/dir2/dir3, but no luck, the MOZ dashboard showed the tag value to be http://www.mysite.com/dir1/dir2/dir3/dir1/dir2/dir3, then we have decided to rewrite the code, and now the canonical to http://wwwmysite.com/dir1/dir2/dir3/?detail1=1?detail2=2 looks like href="http://www.mysite.com/dir1/dir2/dir3/" but the tag on MOZ looks like http://www.mysite.com/dir1/dir2/dir3http://www.mysite.com/dir1/dir2/dir3. So what is the problem? I really got a problem or MOZ does? The code on website looks exactly like href="http://www.aaa.com/en/bbb/ccc/vvv/nnn/" rel="canonical" /> for the page http://www.aaa.com/en/bbb/ccc/vvv/nnn/
Moz Pro | | apartmentGin0 -
Keywords Data Tool: Why is volume metrics unavailable for all of my keywords?
When I use the SEOMoz Pro Tool for Keyword Resarch, I get the notice that the tool is getting improvements. But when I run my keywords all of the volume metric data is unavailable. Why is this?
Moz Pro | | seocoppercupimages0 -
Wordpress tag problem
Hei, Just start using seomoz pro and it's freaking awesome:) I have one question about Crawl Diagnostics and hope you guys can help me out. I just launch my website and i get two errors what greep me out a bit. I don't know how to handle them correctly. I have two duplicate content errors what are caused by Wordpress tag's. If i make more blog posts then i get even more duplicate content issues. how should i handle this "tag" situation? Respectfully, TauriU
Moz Pro | | TauriU0 -
Site rank checking tool
Is there a tool where I can enter a URL and it will tell me all the terms a site ranks for? Basically I recently put up a new website and I want to know what terms I rank in the top 50 for in Google
Moz Pro | | KevinPatrick0 -
Which Google API do you use to creat a rank checking tool?
I can't seem to work this one out. Basically I want to make a very simple rank checker tool something similar to http://www.mikes-marketing-tools.com/ranking-reports/ where a user simply type in a domain and a keyword and in return is shown the position within the results. The problem is I can’t work out which API's I need in order to build it, does anyone know what I need to poke about with? It must work with Google and ideally with Bing and the rest
Moz Pro | | therealmarkhall0 -
Any tools for scraping blogroll URLs from sites?
This question is entirely in the whitehat realm... Let's say you've encountered a great blog - with a strong blogroll of 40 sites. The 40-site blogroll is interesting to you for any number of reasons, from link building targets to simply subscribing in your feedreader. Right now, it's tedious to extract the URLs from the site. There are some "save all links" tools, but they are also messy. Are there any good tools that will a) allow you to grab the blogroll (only) of any site into a list of URLs (yeah, ok, it might not be perfect since some sites call it "sites I like" etc.) b) same, but export as OPML so you can subscribe. Thanks! Scott
Moz Pro | | scottclark0 -
Duplicate content and what to say to my webmaster
Hi, SEOmoz is telling me I have a duplicate content issue between kansascityrealestate dot com and kansascityrealestate dot com/Real-Estate-Homes-Kansas-City.asp my webmaster says Google should figure out is the same page. Suggestions on what to do and how to explain it to the webmaster? Thank you.
Moz Pro | | Ken_Jansen0