KW Explorer is Working to Disambiguate Keywords Google Merges Together
-
Hey gang,
Russ Jones from Moz has been doing a ton of heavy lifting work to try to get around the new problem posed by Google AdWords recent change to merged-keyword volume data. But, we're fighting back against this obfuscation in Keyword Explorer. I'm sharing two emails (slightly edited) from Russ about what we're doing here:
Introduction to the Problem:
Google Adwords Keyword Planner is the primary source for keyword search volume (how often a keyword is searched monthly on Google) for much of the search marketing industry. While Google has grouped together highly-similar terms for a while (especially misspellings), in June of 2016 they dramatically increased this keyword-grouping. This means similar phrases like "keyword rank", "keyword ranking" and "keyword rankings" would all be reported as having the same, combined search volume, rather than their individual search volumes. If you were to take Google's numbers at face value, you might think there are 3,000 searches per month for these 3 terms, when in reality there is only 1,000, divided amongst the 3 terms.
How we are addressing it:
Moz's Keyword Explorer uses a blend of data sources, not just Keyword Planner, to build our volume metrics. This gives us a distinct advantage in that we can adjust the volume of words that deviate dramatically in one data set verses another. Take for example the phrases "keyword rank", "keyword ranking", and "keyword rankings". While Google Keyword Planner might report all of these as having 1,000 searches per month, Moz Keyword Explorer can detect that these numbers are significantly higher than what our models would predict given our other data sets. We can then adjust the volume accordingly. Moreover, given our huge keyword data set, we can also identify grouped phrases (like these 3) and divide the volume proportionally to what we see in our other data sets. Thus, we address the grouping problem from multiple directions.
Here's email #2 from Russ, detailing more of how we're attacking this:
I have been working pretty much non-stop on this keyword volume disambiguation problem (finding the real search volume of individual keywords when Google clumps several together). I think I have settled on a pretty good solution and am working on getting it all in. For example...
Google Keyword Volume for the phrases "briefcase for women" and "briefcases for women" are both at 3600 because they have been lumped together. My disambiguation script says the singular (briefcase for women) should be 2731 and the plural should be 869. Google Trends roughly agrees with this, showing that the singular is searched more than 2x the plural: https://www.google.com/trends/explore#q=briefcase%20for%20women%2C%20briefcases%20for%20women&cmpt=q&tz=Etc%2FGMT%2B4
Basically, Keyword Explorer should already be providing some more accurate/segmented numbers than AdWords, and in the future, we'll get even better thanks to our clickstream data and our evolving models.
Any questions, let us know!
-
Thank you, Russ!
Google confirmed me that this change is due to an update, it won't be rolled back and there's no way to fetch data for each variant individually. Details are here.
Your tool will help us a lot.
-
Thanks for taking the time to come up with a 'solution' to the problem
-
The bug has been fixed but it will take 24 hours for the caches to clear! Thanks again!
-
That is a weird bug, because our database is showing 18k+ for that term! I will investigate!
-
Thank you, Rand and Russ!
I found a weird result. "bag" in US is reported to have 0-10, while "bags" in US is 11.5k-30.3k.
Considering KW planner and Google trend, "bag" in US seems to be outlier.
-
You're working in the right direction, guys. It seems a little scammy on the part of search engines to show these search volumes, as if they prompt you to bid on those keywords because they have a high search volume. While they do show the same SERP for this keyword, I believe a page optimized with "Buy a car in Orlando" will have a better score and a lower bid than a page optimized for "Buys a cars in Orlandos".
-
Thanks!
-
You're welcome for our efforts. I am really excited as we roll out this volume fix. I think it is going to offer a real improvement for SEOs everywhere.
-
Thanks Russ and Rand! I've used many tools for getting to the bottom of estimated volume and have high hopes for your evolving KW Explorer. It's definitely needed.
-
This has a HUGE HISTORICAL impact.
-
Thanks for touching upon this topic which is seriously impacting all marketers who rely on google data. Even the core definition of "Search Volume" is now NOT correct. It's THAT bad as pointed out here http://bit.ly/29MvvvK. Thanks for your efforts.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Did Moz Bar change to have no Keyword capabilities?
I'm trying to use it during SEO training over here and the KW button goes to a "Get Page Optimization Score with MozBar Premium - Try Free", with a link that takes you to: https://hsinfo.moz.com/mozpro/mozbar/lander?utm_medium=cpc&utm_source=google&utm_campaign=Brand | NA&utm_adgroup=Brand - MozBar&utm_term=mozbar&gclid=CjwKCAjwxOCRBhA8EiwA0X8hi4Tx1YaOVwzWZaCGmzmYdBO4JEON8YlRMw52stp2AyfEBbH4uWDnARoCum0QAvD_BwE? Didn't this used to accept keywords and allow keyword checking? My training materials have the KW button behaving like this: [1] Do Keyword Research in MozBar.
Moz Bar | | EricaJorgensen
1. Click the icon with KW and a magnifying glass.
2. Enter a term related to your subject. For example, "cyber security".
There is a section telling you the keyword score, the relevancy to your page, and giving you optimizations that you can make to the page regarding this term.... Thus, I feel sure KW had useful and free features and not a button for a trial and paid Moz Bar Premium account. What is the pricing for this feature now? Or am I missing something? Thanks,
Tracy!0 -
How does Moz gather the Keyword for my campaign in Moz Pro?
Looking at my campaign on Moz Pro and I was wondering where the keywords are generated from as I did not put these in. Can someone please explain?
Moz Bar | | House-Doctors0 -
Working with longtail
How do I work with 'longTails' in Moz? how do I get correct keyword and tails do I write 'keyword and tail' or could I write 'tail and keyword' - I think of order how many words could be used? Three: 'Keyword/Head' and 'modifier' and 'tail'? what do competition do? could I set longTail phrase/words as normal keywords to see ranking in compartion to competition? etc.
Moz Bar | | astridhelene0 -
How does the grader tool treat keyword "stuffing" in ecommerce
We recently started using Moz on our ecommmerce site because I'm concerned that our SEO company doesn't really know what they are doing and I want to see what I can do on my own with the little bit of knowledge I have. It's helping in a number of ways but here's a big question mark: The Grader Tool keeps telling us that our product category pages have too many keywords on them. We are only using them in the content once or twice, but the sub-category buttons on the page show the category + sub repeated. Could this be what's causing it? Does Google distinguish this for ecommerce? We've taken a huge hit in rankings for key phrases and keywords over the past six months and I'm wondering if this is part of it?
Moz Bar | | Creative-Web-Stores0 -
Keyword Difficulty and SERP Analysis Tool
Please can someone explain the following to me: On the Keyword Difficulty tool when I enter a keyword and choose on Google United Kingdom to see the search volume why does it automatically bring back the local and global search volume for Bing? Doesn't make sense. g4JJkug.jpg
Moz Bar | | EveronSEO0 -
On the on page optimization page, I found out that there are 2 contributing factors which are opposite to each other. "No More Than One H1 Tag" and "Appropriate Keyword Usage in H1 Tag"
"No More Than One H1 Tag" and "Appropriate Keyword Usage in H1 Tag" If you fulfill one condition, the other one is not completed. If you consider Article heading as H1 then Moz do not detect keyword in the heading.
Moz Bar | | MoeezLodhi0 -
Google Analytics Connection Failing
Hi there, I am trying to use MOZ Analytics but it keeps saying our Google Analytics has lost connection, if I then reconnect it says it is successful and then when I go to a new page it says it has no connection again. Has anyone experienced this? Does anyone have a fix? Thanks Peter
Moz Bar | | mccormackmorrison0 -
Open site explorer linking root domains
My company has been trying to increase the number of linking root domains for a specific page on our website using our PR company and press releases that are sent out and linked back to this page. This is working nicely, but the number of linking root domains is still not increasing under the "linking root domains" tab. I am noticing the correct links to this domain under "fresh web mentions" though. I know this tool can take a bit to update, but it has been quite some time and I still only see the one link.
Moz Bar | | isret_efront0