Is there a tool that I can use to scrape and see metatags?
-
Looking for a tool that allows me to scrape the websites off a page listing of Google and output a spreadsheet with the websites and their related meta-tag details (mainly title tag). Is there a tool out there that can conveniently allow me to do this?
-
Thanks for everyone's responses! Matt-Antonino, I'll look to implement that solution. Appreciate it!
-
Thanks for sharing Matt-Antonino.
That's good to know!
-
You can do this fairly easily with ImportXML in Google docs or xpath in Excel.
This is the guide that got me started:
https://www.distilled.net/blog/distilled/guide-to-google-docs-importxml/
If you use Chrome, finding the xpath is fairly simple and then you can just add it to your list.
The other way to do this is use Seer's Top 30 Results Scraper alongside the SEO Tools Excel plugin:
http://www.seerinteractive.com/blog/google-scraper-in-google-docs-update
In Excel tools simply use =htmltitle() and get the info you need.
-
Also keep in mind that search engines will change the title displayed in the SERP based on your query, so if you just get the info presented in the SERP, you may not be seeing the actual title tag.
-
Agreed Donna! It would be nice if Screaming Frog did that but it doesn't. I'm not sure of any existing tools that would do that.
You can run each site from the SERP through Screaming Frog to get all that data exported but that would take a good amount of time!
-
I don't think you can use Screaming Frog for that. It will certainly give you a ton of information about a single website, but it doesn't allow you to scrape Google search results and derive meta data for the top X results. Unless I'm missing something....
-
Screaming Frog is a great tool for this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Optimizing images on website. Is it bad to use the same alt names and keywords?
I have a webpage that I have 6 separate images showing step by step instructions of how to use our product with a sentence describing instruction inside image. I took screenshots of the instructions from the products App and uploaded them to webpage because they provide a great visual. I want to make sure I optimize correctly, can I use the same keywords for all the image names?
On-Page Optimization | | artscube.biz0 -
How do you think metatag author will change with google uncoupling them. Will they still affect bing?
With google removing the metag author functionality how do you think metatag author will be used if at all. will functionality change? will it have any use? and should resources being used to implement it? Secondly, will bing utilize it in some way much like they use keywords as a negative signal.
On-Page Optimization | | mycarpetking0 -
How i can make this page more valuable from SEO perspective ???? any suggestion ?
Hi experts , how i can improve following page . please share your thoughts. https://www.protoexpress.com/content/quicklinks.jsp Thanks
On-Page Optimization | | SierraPCB0 -
Can we rank website without main keywords on its homepage?
For example my company website on Google Search Engine... Web Design Company & Digital Agency in Jakarta
On-Page Optimization | | Japracool
coriate.com/
Coriate is a website design & Internet marketing firm in Indonesia. We offer the best web solutions, digital advertising, and SEO Services in the industry. Can I do backlink to it, but different keywords? Like Social Media Management or Facebook Like?0 -
Competitor scraped ecommerce product overview
I noticed by chance that the competitor of an ecommerce client has completely copied one of their product overviews, which is around 500 words in total. The site does not outrank my client, but could the scraped content be harmful in any other way? There are no links included within the text so there's no advantage in that sense. Is Google's algorithm intuitive enough to figure out where the original content came from and attribute it to my client, or is there still the possibility that it could have a negative affect as duplicate content? Any insights and suggestions much appreciated.
On-Page Optimization | | pugh1 -
How can I make google display rich snippets when searching for my domain?
My domain is www.phraseexpander.com If I search for phraseexpander in google, I'm in the first position (as it should be) but google is not giving extra space to my result as it happens, for example, if you search for "fogbugz". Is there any way I can hep google index my contents (I currently have a site index that is created by Yoast SEO). Thanks a lot. Andrea
On-Page Optimization | | nagar0 -
Why is SEOMOZ Crawl Diagnostics not in sync with Webmaster Tools
Currently, my Website, according to the Crawl Diagnostics Summary, has 401 'Duplicate Page Title Errors'. But in Google Webmaster Tools, under Óptimization on the Left hand Side Toolbar, if you look up HTML Improvements, there are only 4 'Duplicate Title Tags'. I have two questions re this: A) Do 'Duplicate Page Title Errors' and 'Duplicate Title Tags' have the same meaning' ? , and B) why are there 401 errors located by the former, and just 4 by the latter?
On-Page Optimization | | ABCPS0 -
Which SEOmoz tool for Optimization Advice?
Which SEOmoz tool can analyse our home page and offer optimization advice and compare with competitors?
On-Page Optimization | | lbohen0