Is there a tool that I can use to scrape and see metatags?
-
Looking for a tool that allows me to scrape the websites off a page listing of Google and output a spreadsheet with the websites and their related meta-tag details (mainly title tag). Is there a tool out there that can conveniently allow me to do this?
-
Thanks for everyone's responses! Matt-Antonino, I'll look to implement that solution. Appreciate it!
-
Thanks for sharing Matt-Antonino.
That's good to know!
-
You can do this fairly easily with ImportXML in Google docs or xpath in Excel.
This is the guide that got me started:
https://www.distilled.net/blog/distilled/guide-to-google-docs-importxml/
If you use Chrome, finding the xpath is fairly simple and then you can just add it to your list.
The other way to do this is use Seer's Top 30 Results Scraper alongside the SEO Tools Excel plugin:
http://www.seerinteractive.com/blog/google-scraper-in-google-docs-update
In Excel tools simply use =htmltitle() and get the info you need.
-
Also keep in mind that search engines will change the title displayed in the SERP based on your query, so if you just get the info presented in the SERP, you may not be seeing the actual title tag.
-
Agreed Donna! It would be nice if Screaming Frog did that but it doesn't. I'm not sure of any existing tools that would do that.
You can run each site from the SERP through Screaming Frog to get all that data exported but that would take a good amount of time!
-
I don't think you can use Screaming Frog for that. It will certainly give you a ton of information about a single website, but it doesn't allow you to scrape Google search results and derive meta data for the top X results. Unless I'm missing something....
-
Screaming Frog is a great tool for this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does anyone use No Sweat WP Internal Links Lite?
Would you recommend it? Are there any other plugins that you'd recommend instead?
On-Page Optimization | | --Chantal--0 -
How i can make this page more valuable from SEO perspective ???? any suggestion ?
Hi experts , how i can improve following page . please share your thoughts. https://www.protoexpress.com/content/quicklinks.jsp Thanks
On-Page Optimization | | SierraPCB0 -
Can you change meta description at any time without loosing rankings?
I'm wondering if it is possible to change the meta description of a page on your site at any time without it affecting rankings on google? Is it only changing how my SERP looks? Or could bad things happen to changing your meta description? Appreciate all opinions on this one, thank you guys!
On-Page Optimization | | danielpett0 -
Which pages should use rel="canonical" links?
I have many pages showing up as multiple content. Most of the them belong to product pages for my store, login pages that show up everywhere on the site, etc. I know that I need to use the rel=canonical link in the header but after searching the forum I'm still unsure of what pages need it. Is it the pages that I don't want searched/crawled by Google or the other way around? Thanks! Crystal
On-Page Optimization | | COfashionista0 -
Should I use this Facebook comment content on my related blog post?
I have a blog post that ranks pretty high for the term "justin bieber tickets". We are running a ticket giveaway and have received tons of responses on Facebook and G+. The responses are often poorly written in they sense that they are from younger fans, but it is a bunch of related content that I thought could be a "good "addition of unique content to the post. Is this a good idea in general? Is it still a good idea if the comments are poorly written and contain lots of slang an exclamation points? Is it bad form to put people's Facebook comments live on the web, even though it is a public page. Here is the post Example of what this would look like in the post >http://cl.ly/1Q3N0t091V0w3m2r442G Source of comments >http://www.facebook.com/SeatGeek Another less aggressive option would be to curate some of my favorite comments... Thanks for any thoughts.
On-Page Optimization | | chadburgess0 -
SEOMOZ tool - on page optmization question
Ok, I had the tool examine a page and while I got an A, it did say this..... Avoid Keyword Self-Cannibalization Easy fix <dl> <dt>Cannibalizing link</dt> <dd>"Kitchen Storage Racks", "Home Storage Racks", "Garage Storage Racks", "Wine Storage Racks", "Bicycle Storage Racks", and "wine storage racks"Explanation</dd> <dd>It's a best practice in SEO to target each keyword with a single page on your site (sometimes two if you've already achieved high rankings and are seeking a second, indented listing). To prevent engines from potentially seeing a signal that this page is not the intended ranking target and creating additional competition for your page, we suggest staying away from linking internally to another page with the target keyword(s) as the exact anchor text. Note that using modified versions is sometimes fine (for example, if this page targeted the word 'elephants', using 'baby elephants' in anchor text would be just fine).</dd> <dt>Recommendation</dt> <dd>Unless there is intent to rank multiple pages for the target keyword, it may be wise to modify the anchor text of this link so it is not an exact match.</dd> </dl> The keyword that was optimized was "storage racks". In the explanation it says that baby elephants is fine if elephants is your keyword so why isn't wine storage racks or kitchen storage racks ok what is the difference? why is mine cannibalizing but baby elephants is not? This may be very simplistic to you all but I'm learning as i go, thank you in advance
On-Page Optimization | | stacksofracks0 -
Where can I find broken link.
Hi there, I got some 404-errors in crawl diagnostics. How can I get the URLs where the broken links were found?
On-Page Optimization | | fleetway0 -
Can A Blog post impact negatively on Google rankings?
We used to rank fairly highly on Google for our preferred search term, but once we introduced a blog (or rather the blog excerps) onto our home page we dropped from page 1 to page 3 for our preferred search term. We have made the assumption this may be down to diluting of keywords and therefor the key phrase or message to the Search Engines was not as clear as it was before. Is this generally accepted as being the case ? If so - should each and every blog post excerpt start with the key seo search phrase to maintain the integrity of that search phrase ? or perhaps even better still is it best to have the blog on a dedicated page only with no excerpts on the home page ? We are using Wordpress and also using multiple categories within the blog - is it perhaps best to just have all blog postings on the one page and use TAGS more often? Thanksing you in advance.
On-Page Optimization | | kiswebsltd0