Is there a tool that I can use to scrape and see metatags?
-
Looking for a tool that allows me to scrape the websites off a page listing of Google and output a spreadsheet with the websites and their related meta-tag details (mainly title tag). Is there a tool out there that can conveniently allow me to do this?
-
Thanks for everyone's responses! Matt-Antonino, I'll look to implement that solution. Appreciate it!
-
Thanks for sharing Matt-Antonino.
That's good to know!
-
You can do this fairly easily with ImportXML in Google docs or xpath in Excel.
This is the guide that got me started:
https://www.distilled.net/blog/distilled/guide-to-google-docs-importxml/
If you use Chrome, finding the xpath is fairly simple and then you can just add it to your list.
The other way to do this is use Seer's Top 30 Results Scraper alongside the SEO Tools Excel plugin:
http://www.seerinteractive.com/blog/google-scraper-in-google-docs-update
In Excel tools simply use =htmltitle() and get the info you need.
-
Also keep in mind that search engines will change the title displayed in the SERP based on your query, so if you just get the info presented in the SERP, you may not be seeing the actual title tag.
-
Agreed Donna! It would be nice if Screaming Frog did that but it doesn't. I'm not sure of any existing tools that would do that.
You can run each site from the SERP through Screaming Frog to get all that data exported but that would take a good amount of time!
-
I don't think you can use Screaming Frog for that. It will certainly give you a ton of information about a single website, but it doesn't allow you to scrape Google search results and derive meta data for the top X results. Unless I'm missing something....
-
Screaming Frog is a great tool for this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Internal anchor text. Should we still use keywords?
I have a review site that has approximately 70 category pages. I'd like to include a few of them (not all 70) in the footer of the page for easy navigation and to direct the crawlers to the best ones. Is it advisable to use anchor text of "Category + reviews" or just leave it as "Category". I certainly dont want it to be overoptimized, but I do think its a good usability cue, so I'd be surprised if it was against guidelines. Any thoughts?
On-Page Optimization | | jim_shook0 -
Why am I not seeing sitelinks for this website?
http://laleablack.com/ It's been around for a few months - I have other sites showing sitelinks in the search results. but when I search for "laleablack" "lalea and black" I don't see anything...anyone have any idea why? Links have proper anchortext etc
On-Page Optimization | | smlsml0 -
Can you use multiple keywords for on page for ranking?
I understand using a keyword (or phrase) and correctly building that into the site structure (URL, Title Tag, body, etc). So, this question is going to be elementary, but I am starting to question myself as I write content. I have a client, for example, that has a new site and a page for Chocolate cakes. Now the other pages they built out are for Cheesecakes, Cupcakes, etc. So we optimized the Chocolate cakes page with our keyword throughout (Getting an A+ on page content grade). But now they are asking me why they can't be found for chocolate eclairs, chocolate fudge cake, devils chocolate cake, double chocolate cake, etc. My first quick answer is that they should build more pages. But am I doing this wrong?
On-Page Optimization | | cschwartzel0 -
How can i change my landing page title in search engines?
Hi SEO folks, Please help! I've changed my home page title 30 days ago, but my Google search results is still showing the old one! Why is that happening? can I've a brief explanation please so i can learn. thanks a million cRnPa6d
On-Page Optimization | | aptustelecom0 -
Using Iframes for Affiliate Ads
Hey all, I got a question: is it Ok to use an Iframe for example to list some Vacation Houses in my Travel Website? This is an Affiliate kind of Program Iframe Link. I did write unique Content about 400 Words and put this Text below the Affiliate Iframe, is this good or not?
On-Page Optimization | | myrtus190 -
Using fathead page keywords for directories and as a red herring to competitors
I'm fairly new to SEO and I have been reading a lot on here and the SEOmoz guides over the last few days, finding it very interesting. I am wondering about page keywords, I read that the engines no longer use them. In this thread they say they still use them because of directories. http://www.seomoz.org/ugc/why-i-still-use-meta-keywords#new-comment So I was wondering, because directories are always smaller scale than search engines would keywords that are normally high competition have more clout in them? If so then using them could be misleading to competition if they think they are the actual keywords? or might this contradict between your actual chosen keywords in the directories backlink anchor text or something?
On-Page Optimization | | Zoolander0 -
Do you think using accordion text can hurt SEO?
I have a lot of text for my home page. My plan is to a J Query Plugin for accordion text. Does anyone think that this can hurt SEO efforts?
On-Page Optimization | | DTOSI1 -
Can you optimize for 2 keywords per URL?
Or should you just stick to 1 page, 1 keyword all the time? If you do 2, are there any things you should watch out for? Thanks
On-Page Optimization | | inhouseninja0