Is there a tool that I can use to scrape and see metatags?
-
Looking for a tool that allows me to scrape the websites off a page listing of Google and output a spreadsheet with the websites and their related meta-tag details (mainly title tag). Is there a tool out there that can conveniently allow me to do this?
-
Thanks for everyone's responses! Matt-Antonino, I'll look to implement that solution. Appreciate it!
-
Thanks for sharing Matt-Antonino.
That's good to know!
-
You can do this fairly easily with ImportXML in Google docs or xpath in Excel.
This is the guide that got me started:
https://www.distilled.net/blog/distilled/guide-to-google-docs-importxml/
If you use Chrome, finding the xpath is fairly simple and then you can just add it to your list.
The other way to do this is use Seer's Top 30 Results Scraper alongside the SEO Tools Excel plugin:
http://www.seerinteractive.com/blog/google-scraper-in-google-docs-update
In Excel tools simply use =htmltitle() and get the info you need.
-
Also keep in mind that search engines will change the title displayed in the SERP based on your query, so if you just get the info presented in the SERP, you may not be seeing the actual title tag.
-
Agreed Donna! It would be nice if Screaming Frog did that but it doesn't. I'm not sure of any existing tools that would do that.
You can run each site from the SERP through Screaming Frog to get all that data exported but that would take a good amount of time!
-
I don't think you can use Screaming Frog for that. It will certainly give you a ton of information about a single website, but it doesn't allow you to scrape Google search results and derive meta data for the top X results. Unless I'm missing something....
-
Screaming Frog is a great tool for this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
IMG TITLE no longer used in Wordpress?
Err, when did this happen? Although you can still enter a Title in the WP image library, when inserting into a post the Title tag is not implemented. Alt text is there OK but not Title. There was a plugin around that restored this basic seo functionality but it's no longer available. I mean - honestly!
On-Page Optimization | | robandsarahgillespie0 -
Should I use 'Click here' as an inbound link for my cornerstone content?
Hello Should I use 'Click here' as an inbound link for my cornerstone content? Example: For a full selection of our Facebook Event Attendee packages, please click here. OR Example: Please click the following link for a selection of our Facebook Event Attendee packages. This is my product page to help you better understand the context: LikeChimp
On-Page Optimization | | xdunningx0 -
Best Site Architecture tool for analysis my & competitors site?
Hello All, I am really confused with my current architecture for Ecommerce site, can you please suggest any tool or software where I can analysis mine and competitors site architecture ? Thanks!
On-Page Optimization | | pragnesh96390 -
Recommendation for keyword relevancy/density tool
Can anyone give a recommendation other good keyword relevancy and density tool? Thanks
On-Page Optimization | | seoman100 -
Does CTR Affect Ranking & Authority? Can PPC Influence That Too?
Hi everyone, Good CTR and bounce rate seem to affect rankings positively, but what about domain authority? Is that something built entirely on links and semantics, or does CTR play a factor too? Consider a homepage ranking for its brand name. Switching off any brand PPC will increase the natural listing's CTR. Would that have a positive SEO impact on the homepage/domain?
On-Page Optimization | | tprg0 -
Google Map Marker not showing up when using HTML Embed Code
Hi community, For several clients, when embedding the Google Maps, the Marker DOES NOT appear. I am copying straight from Google Maps, it appears fine in Google Maps. Is there HTML I can add or is there something wrong with the map marker to begin with? These are verified listings. Help! Thank you! Priscilla
On-Page Optimization | | FullMedia900 -
Tools for seaching for keyword rich domains
Could I get some recommendations please for tools that will help me find keyword rich domains in my space. Also I did try out the Go Daddy bulk domain checker (just copy and paste domains into box) but it doesn't let me bulk search .co.uk domains. Any ways around that one?
On-Page Optimization | | Clicksjim0 -
Using rel="author" on product descriptions
Unique and effective product descriptions can be one of the most expensive investments that go into building a retail website. I would consider them part of the "intellectual property" of a company. These descriptions are also one of the most often pirated types of content. Some product descriptions have been grabbed and used by hundreds of pirates. When people grab your product descriptions it creates a duplicate content problem, it also starts cutting off your long-tail traffic. The discussion topic here is.... Have you heard of anyone using rel="author" on product pages with substantive content? Do you think there is any value in doing that? Is this an abuse of rel="author" Thank you!
On-Page Optimization | | EGOL1