Is there a tool that I can use to scrape and see metatags?
-
Looking for a tool that allows me to scrape the websites off a page listing of Google and output a spreadsheet with the websites and their related meta-tag details (mainly title tag). Is there a tool out there that can conveniently allow me to do this?
-
Thanks for everyone's responses! Matt-Antonino, I'll look to implement that solution. Appreciate it!
-
Thanks for sharing Matt-Antonino.
That's good to know!
-
You can do this fairly easily with ImportXML in Google docs or xpath in Excel.
This is the guide that got me started:
https://www.distilled.net/blog/distilled/guide-to-google-docs-importxml/
If you use Chrome, finding the xpath is fairly simple and then you can just add it to your list.
The other way to do this is use Seer's Top 30 Results Scraper alongside the SEO Tools Excel plugin:
http://www.seerinteractive.com/blog/google-scraper-in-google-docs-update
In Excel tools simply use =htmltitle() and get the info you need.
-
Also keep in mind that search engines will change the title displayed in the SERP based on your query, so if you just get the info presented in the SERP, you may not be seeing the actual title tag.
-
Agreed Donna! It would be nice if Screaming Frog did that but it doesn't. I'm not sure of any existing tools that would do that.
You can run each site from the SERP through Screaming Frog to get all that data exported but that would take a good amount of time!
-
I don't think you can use Screaming Frog for that. It will certainly give you a ton of information about a single website, but it doesn't allow you to scrape Google search results and derive meta data for the top X results. Unless I'm missing something....
-
Screaming Frog is a great tool for this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can you transcribe your youtube video to just google?
YouTube videos have been very effective for us on our site. The only problem is they have taken part of a fair amount of our content so to google our pages may seem to have minimal content. Transcribing each video and including that on the page would take away from the look of the page and clutter it. Is there a way to let google know the content without having to include it on the page? You can find an example page at https://www.waikoloavacationrentals.com/halii-kai-rentals/
On-Page Optimization | | RobDalton0 -
Should you aim for Google to use your meta tags?
When updating meta titles and descriptions, I'm taking note of whether Google is displaying the set tag or changing it to copy from the page. Does this affect the ranking position if Google is having to change the tag? How much should I worry if Google is choosing to change every other page? Thanks!
On-Page Optimization | | Omar_aw0 -
Can any one give some advise on how to work out which back links are bad
we are trying to clean up our site and believe we have bad back links can any one tell me how to work out which ones to disavow
On-Page Optimization | | CostumeD0 -
Can Javascript Links Be Used to Reduce Links per Page?
We are trying to reduce the number of links per page, so for the low-value footer links we are considering coding them as javascript links. We realize Google can read java, but the goal is to reduce level of importance assigned to those internal links. Would this be a valid approach? So the question is would converting low-value footer links to js like below help reduce the number of links per page in google's eyes even though we're reasonably sure they can read javascript. <a <span="" class="html-tag">href</a><a <span="" class="html-tag">="</a><a class="html-attribute-value html-external-link" target="_blank">javascript:void(0);</a>" data-footer-link="/about/about">About Us
On-Page Optimization | | Jay-T0 -
How to peroperly use h1 , h2 and h3 tag on your website.
Is it better to have different h1 for each page or have the same h1 across the site. I am using h1 fin wordpress for beside that I have 4 more h1 in the same page how to properly use h2 and h3 can we have muliple h2 on a page. what would be an ideal hx tag order be ? h1
On-Page Optimization | | conversiontactics
h2
h2- h3 h3 If anyone can provide some answers Many thanks0 -
Best Way to Use Date in Title
Hi, I do most of the current copy for our blog which you can find here http://appointedd.com/blog/ I believe having a regular blog structure with a mix of irregular ad hoc posts to go in around these. So, for this blog, I write an article on "Beauty Industry News" every week. Now, I don't want to use the same title for each post, so I've peen butting in the date after each one i.e. "Beauty Industry News - 24/04/13". Is this best practice or is there a better way of naming regular posts? Thanks in advance!
On-Page Optimization | | LeahHutcheon0 -
Can PDFs on your website be picked up in search engines?
Can PDFs on your website be picked up in search engines? There's a ton of info online that says it can and can't be picked up.
On-Page Optimization | | JennH0 -
Client needs a basic page analysis tool
I have a client that I work with that is a real estate business. They aren't in need or don't want to pay for full seo services at this time, but would like to do some basic page analysis and correction to make sure their pages are at least somewhat properly target for their keywords. The SEOMOZ tools that I have access to as a PRO are overkill for their needs. Do you all know of any basic tools that can just handle something like the page analysis feature of seomoz? Thanks for your help. Steven
On-Page Optimization | | sfmatthews0