Is there a tool that I can use to scrape and see metatags?
-
Looking for a tool that allows me to scrape the websites off a page listing of Google and output a spreadsheet with the websites and their related meta-tag details (mainly title tag). Is there a tool out there that can conveniently allow me to do this?
-
Thanks for everyone's responses! Matt-Antonino, I'll look to implement that solution. Appreciate it!
-
Thanks for sharing Matt-Antonino.
That's good to know!
-
You can do this fairly easily with ImportXML in Google docs or xpath in Excel.
This is the guide that got me started:
https://www.distilled.net/blog/distilled/guide-to-google-docs-importxml/
If you use Chrome, finding the xpath is fairly simple and then you can just add it to your list.
The other way to do this is use Seer's Top 30 Results Scraper alongside the SEO Tools Excel plugin:
http://www.seerinteractive.com/blog/google-scraper-in-google-docs-update
In Excel tools simply use =htmltitle() and get the info you need.
-
Also keep in mind that search engines will change the title displayed in the SERP based on your query, so if you just get the info presented in the SERP, you may not be seeing the actual title tag.
-
Agreed Donna! It would be nice if Screaming Frog did that but it doesn't. I'm not sure of any existing tools that would do that.
You can run each site from the SERP through Screaming Frog to get all that data exported but that would take a good amount of time!
-
I don't think you can use Screaming Frog for that. It will certainly give you a ton of information about a single website, but it doesn't allow you to scrape Google search results and derive meta data for the top X results. Unless I'm missing something....
-
Screaming Frog is a great tool for this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How can i check which inbound links to my site go to 404 pages?
I have external links coming into my site going to 404 pages, but i cant seem to find a way to search all broken links pointed at my website.
On-Page Optimization | | NickJPearse0 -
IMG TITLE no longer used in Wordpress?
Err, when did this happen? Although you can still enter a Title in the WP image library, when inserting into a post the Title tag is not implemented. Alt text is there OK but not Title. There was a plugin around that restored this basic seo functionality but it's no longer available. I mean - honestly!
On-Page Optimization | | robandsarahgillespie0 -
How can i define a ALT Tag for Youtube videos?
Hello, When i scan with SEMrush it shows all such pages do not have ALT Tags http://img.youtube.com/vi/iJ4pmmRSZxc/hqdefault.jpg What should the ALT be for them and how can i control as we have 1000's of Youtube videos displayed on various parts of our website Thank you
On-Page Optimization | | ktrinkqao120 -
Google Webmaster Tools - Inappropriate Keywords
In December our website was the victim of a devastating pharma hack. Google Webmaster Tools never reported malware on our website, but our keywords within Webmaster Tools were all changed to keywords related to mens and ladies watches. Our Google organic search rank and resulting traffic has been dramatically impacted. Since realizing we were hacked, we rebuilt our website from the ground up with a clean and updated installation of Joomla CMS (from 1.5 to 2.5) and changed to a more secure server. As of December 21st, 2012, our website has been clean of the phama hack. We wrote Google and told them what happened. They replied with a "no manual spam actions were found" message. Unfortunately, Google Webmaster Tools still reflects all of the hacked keywords for mens and ladies watches. We are watching our Google Webmaster Tools everyday waiting for Google to remove the hacked keywords. It's been a little over a month and still only about 5 of the first 100 keywords have anything to do with our website. What do you recommend we do to expedite the removal of these inappropriate keywords in Google WMT?
On-Page Optimization | | TCM-SEO0 -
Using Transcription Service For Videos - Have Question Around Search and Spiders
Hi All, So I have put together a weekly video series on security topics. I have read an SEOmoz post around how you can boost SEO by adding the transcription to the page, which makes perfectly good sense. My question is, can I include the first couple of paragraphs and then have a "read the full transcription" so when the user clicks, the rest of the content appears? Do the search engine spiders only crawl the first two paragraphs in this instance or do they crawl the whole thing even though the entire content is not on the page? I dont mind making the page longer and including the entire transcription if it is easier for SEO but if there is no difference, than I think the first option would be the best user experience. Thanks for the help Pat
On-Page Optimization | | PatBausemer0 -
Can anyone recomend a good, solid, review generator for WP?
Looking for some feedback on a good review generator for customer input and hopefully generate some testimonials. Thanks in advance.
On-Page Optimization | | tvw1300 -
Correct use of Canonical link vs 301 redirect
Hi All, Seeking yet more advice. SEOMOZ tools have told me I have duplicate content on one of my sites and I am keen to clean this up. I am not to familiar with the following so thought I would ask. The duplicate content is shown on : www.mysite.com www.mysite.com/index.html Obviously I only see index.html when I check the code so what is the best method of resolving the duplicate content, Canonical or 301? Can you give me an example 🙂 Thanks all
On-Page Optimization | | wedmonds0 -
Should a no-follow tag be used on a ssl or trust seal?
I'm just wondering if there would be some benefit if this was followed since the purpose of it is to add trust to your site.
On-Page Optimization | | BradBorst0