Is there a tool that I can use to scrape and see metatags?
-
Looking for a tool that allows me to scrape the websites off a page listing of Google and output a spreadsheet with the websites and their related meta-tag details (mainly title tag). Is there a tool out there that can conveniently allow me to do this?
-
Thanks for everyone's responses! Matt-Antonino, I'll look to implement that solution. Appreciate it!
-
Thanks for sharing Matt-Antonino.
That's good to know!
-
You can do this fairly easily with ImportXML in Google docs or xpath in Excel.
This is the guide that got me started:
https://www.distilled.net/blog/distilled/guide-to-google-docs-importxml/
If you use Chrome, finding the xpath is fairly simple and then you can just add it to your list.
The other way to do this is use Seer's Top 30 Results Scraper alongside the SEO Tools Excel plugin:
http://www.seerinteractive.com/blog/google-scraper-in-google-docs-update
In Excel tools simply use =htmltitle() and get the info you need.
-
Also keep in mind that search engines will change the title displayed in the SERP based on your query, so if you just get the info presented in the SERP, you may not be seeing the actual title tag.
-
Agreed Donna! It would be nice if Screaming Frog did that but it doesn't. I'm not sure of any existing tools that would do that.
You can run each site from the SERP through Screaming Frog to get all that data exported but that would take a good amount of time!
-
I don't think you can use Screaming Frog for that. It will certainly give you a ton of information about a single website, but it doesn't allow you to scrape Google search results and derive meta data for the top X results. Unless I'm missing something....
-
Screaming Frog is a great tool for this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can I reuse meta description tag on another site?
Hi....lets say i sell widgets and on my site i have redWidgets, blueWidgets and greenWidgets. Each of these widget page's has a meta description tag that seems to help click through. I now have a different site that would like to do a right up about each widget and will dedicate a independent page to each widget. Can i safely provide them with the original meta descriptions (from my original site) for each widget i have on my site to then use on these "right up" pages (as they seem to work well and are informative of the subject matter). I am not sure if this is a seo issue or not. I would think not but would appreciate any input. thank you
On-Page Optimization | | nomad-2023230 -
Can't see the woods for the trees
Ok, I'm going be really cheeky here, so apologies in advance! We have this site www.simplychaise.co.uk and its not ranking anywhere in the top 50 for the term 'Chaise Longue' Moz has picked up a few issue with duplicate titles and a couple of 404's which I will fix shortly, It dosen't have any backlinks but I'm stumped as to why it isn't ranking higher than what it is, I'm not expecting 1st position but outside of the top 50 is something else. The site looks ok to me, but I think it might be a case of I've been looking at it so long that I can no longer see the wood for the trees. Could any kind hearted Mozer point me in the right direction here please, what am i missing? I'd greatly appreciate it, many thanks in advance for being so cheeky and well, useless! Jon
On-Page Optimization | | Jon-S0 -
Advantage of using LocalBusiness rich snippets?
I am working on a website that has company profile pages. What are the advantages of using LocalBusiness rich snippets for profiles?
On-Page Optimization | | calf0 -
Looking for a Tool to Assist with Site Optimization. Does it already exist?
I'm looking for a tool that can help us quickly identify web pages on a client's site that contain a selected keyword phrase.
On-Page Optimization | | RosemaryB
I would like to enter say 100 keyword phrases and the client's URL and receive a report that shows - for each keyword - the client URLs that contained that exact phrase. Does anyone know of a tool that can do this? Thank you, Rosemary Brisco0 -
Using Subdomains to Avoid Sitewide Penalties?
If I'm using a subdomain on my website, for instance news.mywebsite.com, and it gets penalized by Panda (or whatever animal update), would that affect the main domain and/or other subdomains?
On-Page Optimization | | sbrault740 -
Removing old URLs that are being used for my on page optimization?
Is there a way to remove old URL's that are still being used for my keywords for my on page optimization? They are giving me grades of F since they no longer exist and if I change the URL to the current one, the grade becomes an A, but they are still showing after the new crawl.
On-Page Optimization | | Dirty0 -
Using display: none in h1 tag
Hello, For the h1 tag on my landing page, I currently have 'Welcome to Edison Ford'. I was thinking of adding the keyword I'm targeting (property maintenance bristol) to the h1 tag which would look like this 'Welcome to Edison Ford Property Maintenance Bristol' Would it be a good idea to wrap the property maintenance bristol part in a span tag and add 'display: none;' to the styling? Thanks in advance.
On-Page Optimization | | PeterAllen910 -
How can I get on-page analysis reports ?
I started trying out seomoz' facilities as a way to give myself a checklist of things to do-and-don't while learning SEO. Faced with a ton of new and interesting information, I started optimizing my home page and writing some content that can tell a story to people in my business. So I started using on-page analysis tools. But the campaign opening screen is telling me to wait for reports approx. two weeks. There are some reports ( not so good ones, a lot to improve ) but not the one I need most: the on-page analysis one. I set up two campaigns and I have the same problem for both. Am I doing something wrong ? Can I change my pages to make this work ?
On-Page Optimization | | wiebe0