Tool for scanning the content of the canonical tag
-
Hey All,
question for you. What is your favorite tool/method for scanning a website for specific tags? Specifically (as my situation dictates now) for canonical tags?
I am looking for a tool that is flexible, hopefully free, and highly customizable (for instance, you can specify the tag to look for). I like the concept of using google docs with the import xml feature but as you can only use 50 of those commands at a time it is very limiting (http://www.distilled.co.uk/blog/seo/how-to-build-agile-seo-tools-using-google-docs/).
I do have a campaign set up using the tools which is great! but I need something that returns a response faster and can get data from more than 10,000 links. Our cms unfortunately puts out some odd canonical tags depending on how a page is rendered and I am trying to catch them quickly before it gets indexed and causes problems. Eventually I would also like to be able to scan for other specific tags, hence the customizable concern. If we have to write a vb script to get it into excel I suppose we can do that.
Cheers,
Josh
-
No idea on that one - it's still pretty new. The developers actually chimed in on the post, so you could ask them in the comments.
-
Thanks Dr. Pete and Marcus.
I just finished reading the post. I have looked at Screaming Frog before but was hoping to be able to find a way to do it myself. Just didn't want to plop money down on something that seemed like it should be able to be done using tools I already had. But the software does look good. Any thought on if they will come out with a one time purchase instead of a yearly subscription?
Cheers!
Josh
-
Hey Dr. Pete, Joshua
I was just coming here to say that I had read the Dr. Pete post and this may do the job. It's a paid bit of a software but I will be picking it up later. I have my guys knocking up a canonical checker that will be free for all but that may take a day or so to get perfect.
Let me know if you have a play with Screaming Frog!
Marcus
-
I'm pretty sure that Screaming Frog SEO Spider will do it, but you need the paid version to custom-filter on the canonical tag. I've got a post going up about it tomorrow.
-
Great, really appreciate it! Many thumbs up
-
Hey Josh,
Right, cool. I have got a few jobs to sort out but I am going to have a bash at knocking this up this afternoon. Should be easy enough (he said, damning himself to hours of problems).
Leave it with me for 24 hours.
Marcus
-
Hey Marcus,
thanks for the quick response. That is exactly what I would be looking for. I do have a list of url's and that is also simple enough to get from something like xenu. Would love to work with you on this.
Thanks.
Josh
-
Hey, I am not aware of any such tool, but it should not be too hard to put one together, maybe a useful little tool as well.
If you have all of your pages in spreadsheet or database, it should be easy enough to write a little script that cycles through them.
Start Loop
-
request page
-
parse code to get canonical URL
-
compare page to canonical
-
output problem URLs
End Loop
Slightly over simplified and requires a list of all your URLs but would be willing to help put something like this together, could be useful for all of us, especially for those (like me) that work with a lot of CMS sites.
Cheers
Marcus
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Missing Description Tag
I pulled the latest moz report and my category pages are being flagged as missing description tag, but not only is the description visible on each page, it is also in the code for all to see. Here is the code, what am I missing? | |
Moz Pro | | moon-boots
| | |
| | |
| | |
| | dir="ltr" class="ltr" lang="en"> | | |
| | |
| | |
| | |
| | |
| | <title>Astronaut Costumes</title> |
| | <base href="<a href=" http:="" www.interstellarstore.com="" "="">http://www.interstellarstore.com/" /> |
| | |
| | |
| | http://www.interstellarstore.com/image/catalog/Earth.png" rel="icon" /> |
| | catalog/view/theme/pav_WindOnline_Store/stylesheet/bootstrap.css" rel="stylesheet" /> |
| | catalog/view/theme/pav_WindOnline_Store/stylesheet/stylesheet.css" rel="stylesheet" /> |
| | catalog/view/theme/pav_WindOnline_Store/stylesheet/customize/1455569423.css" rel="stylesheet" /> |
| | catalog/view/javascript/font-awesome/css/font-awesome.min.css" rel="stylesheet" /> |
| | catalog/view/theme/pav_WindOnline_Store/stylesheet/animate.css" rel="stylesheet" /> |
| | catalog/view/javascript/jquery/magnific/magnific-popup.css" rel="stylesheet" /> |
| | catalog/view/javascript/jquery/owl-carousel/owl.carousel.css" rel="stylesheet" /> |
| | catalog/view/theme/pav_WindOnline_Store/stylesheet/fonts.css" rel="stylesheet" /> |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |0 -
Duplicate content on SearchResults.asp
hi guys. I'm currently working through the reported crawl errors in Moz Analytics, but an unsure what to do about some of them. for example... Searchresults.asp?search=frankie+says+relax is showing as having duplicate page content and page title as SearchResults.asp?searching=Y&sort=13&search=Frankie+Says+Relax&show=24 There's all sorts of searchresults.asp page being flagged. Is this something i can safely ignore or is it something i should endeavour to rectify? I'm also getting errors reported on shoppingcart.asp pages as well as pindex.asp (product index). I'm thinking i should maybe add disallow/ shoppingcart.asp to my robots text file, but am unsure as to whether i should be blocking robots from the search results pages and product index (which is essentially a secondary sitemap). Any advice would be greatly appreaciated. Thanks, Dave 🙂
Moz Pro | | giddygrafix0 -
Rank Checker Tool
I have more than 25 keywords ranked in the top 30 for various sites and some of these keywords were inputted a couple weeks ago. However, only one of them has shown a position change. Is there something wrong with the software? It says the next rankings update is April 7th. When was the last rank update?
Moz Pro | | priceseo0 -
Is Anyone Else Having Problems With The Ranking On Pro Tools?
After checking them from the report I was emailed, some of them seem to be incorrect, or is it something my end? To be fair the majority of them are correct, I'm just querying it.
Moz Pro | | JonathanRolande0 -
Crawl Diagnostics - Canonical Question
On one of my sites I have 61 notices for Rel Canonical. Is it bad to have these or is this just something that's informative?
Moz Pro | | kadesmith0 -
Why cant I hook up facebook to SEO Moz Campaign Tool?
Greetings from the digital epicentre otherwise known as Wetherby Uk 😉 I want to track sentiments ie mentions, slurs fliratations of a brand on Facebook. So to start out with I thought 'Id hook up SEO moz social tracking service as illustrated here: http://i216.photobucket.com/albums/cc53/zymurgy_bucket/cant-add-facebook-url.jpg But whilst i could add my twitter account I caount not add my favebook page:http://www.facebook.com/david.honan.98I added david.honan.98 in the url box and a number of other versions but none successfully hooked up. Am enetering the wrong url or is SEO moz socail media facebook plugin jinxed? Thanks in advance, David
Moz Pro | | Nightwing0 -
Conical tag question
I have now 124 notices showing rel = conical as follow , can you please advise are they ok , they might be due to new wordpress plugin URL: http://www.domain.com Tag value http://www.domain.com are they ok ? Although they look same but then why are they there , how can i remove them in word press and is there any reason for them to be left or removed . My site always uses www, if you put non www address it resolves automatically to www. My ranking have suddenly dropped as well . can it reason . I am aware of new update .
Moz Pro | | HateDoingSEO0 -
Moz tool bar showing less links
Just checked our links for a couple of our sites and noticed that the number of inbound links has dropped from around 55,000 to 13,000 on one and from 6000 to 700 on the other. GWMT still showing the previous amounts. Anyone else experienced this over the last few days?
Moz Pro | | heatherrobinson0