How to hold a variable constant for an A/B test
-
For example, let's say you want to A/B test a title tag change. You are hoping to identify whether a title tag change increases CTR. But, position is always fluctuating a bit and that affects CTR, too. So, I'm interested in how you could hold position constant in order to isolate the change in CTR that is due to the title tag change. Does anyone know of resources/tools/tutorials for how to do this?
It's been... a very long time since I took statistics (-: I have access to Excel, MS Access, and R studio.
-
Thanks for the reply. I'll check out the links you included.
I thought it might be helpful to show an example of what got me thinking along these lines. This is a study about A/B testing of title tag changes. They don't say they accounted for position fluctuation; maybe they didn't, but it seems like you'd have to in order to have meaningful results.
-
I don't see a way of doing this accurately. With organic rank fluctuations, seasonality, competition it's near impossible to "hold" a position. However, if you have a position in serps for a specific keyword with little fluctuation and get decent traffic you can establish this as your baseline. Once the title is updated and appears in the serps, begin monitoring w/search console, analytics or etc. and see if you see any decent jumps. Some links for additional information: Finding the ROI of Title tag changes using Google's CausalImpact R package, SEO Split Testing & A Beginner’s Guide to A/B Testing: Effective SEO Landing Pages. Would love to hear if anyone else has a better way.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to carry across/capture linkjuice during an SEO site migration
Hi there - I am planning out an SEO migration but this thought just occured to me: If the links into a site's previous URL went to the non-canonical version of the domain name - e.g. to: https://theguardian.com/uk and not the correct version of that URL, which is: https://www.theguardian.com/uk Then, if I do a redirect simply from the correct canonical version of the domain:
Intermediate & Advanced SEO | | McTaggart
https://www.theguardian.com/uk - rather than the versions of the domain that are being pointed to by backlinks - e.g. https://theguardian.com/uk - then the migration will not be carrying across all the linkjuice from the previous site. So how would you suggest dealing with this issue?0 -
Google balances SERP results with positive and negative News/PR?
Hey guys, We did reputation management back in March 2017. We basically built high quality links to online assets such as linkedin, twitter, facebook, positive PR articles and other web properties in order to rank them higher then negative PR. However there was 0 change (the link building was solid). And the negative PR remains in the top 10 with also positive new articles about the site. At this point, i believe that Google is keeping the negative PR in the top 10 to keep balanced SERP results. Does anyone know if this is something Google does to balance positive and negative results? Cheers, Chris
Intermediate & Advanced SEO | | cathywix0 -
SITEMAP - Does <changefreq>and <image:title>have any apreciable effect?</image:title></changefreq>
Hi everyone. It was hard to find some actual evidence that some of the atributes to be declared in a sitemap have some real impact.
Intermediate & Advanced SEO | | Gaston Riera
Particularly, im interested in these two: <changefreq></changefreq> and**image:title</image:title>** I've used them in a few cases just to check their effect and couldnt see any.
Do you have any experience with these? Or any other atribute that might be helpful, in order to create a more accurate and effective sitemap? Also, this could be a great topic to create a new Moz Blog post, the one about sitemap is 8years old.0 -
Which is better /section/ or section/index.php?
I have noticed that Google has started to simply link to /section/ as opposed to /section/index.php and I haven't changed any canonical tags etc. I have looked at my pages moz authority for the two /section/ = 28/100
Intermediate & Advanced SEO | | TimHolmes
/section/index.php = 42/100 How would I go about transferring the authority to /section/ from /section/index.php to hopefully help me in my organic serp positions etc. Any insight would be great 🐵0 -
Redirecting Pages from site A to site B
Hi, I have a client who have a solid, high ranking content based site (site A). They have now created an ecommerce site in addition (site B). To give site B a boost in terms of search engine visibility upon launch, they now wish to redirect approx 90% of site As pages to site B. What would be the implications of this? Apart from customers being automatically redirected from the page they thought they where landing on, how would google now view site A? What are your thoughts to thier idea. I am trying to talk them out of it as I think its a poor one.
Intermediate & Advanced SEO | | Webrevolve0 -
Ending URLs in .html versus /
Hi there! Currently all the URLs on my website, even the home page, end it .html, such as http://www,consumerbase.com/index.html Is this bad?
Intermediate & Advanced SEO | | Travis-W
Is there any benefit to this? Should I remove it and just have them end with a forward slash?
If I 301 redirect the old .html URLs to the forward slash URLs, will I lose PA? Thanks!0 -
Microdata / Schema.org and HTTPS
I have a quick question regarding Microdata / Schema.org files that are not hosted on secure connections. I receive a receive a security error from my e-commerce site because the code references the schema over HTTP instead of HTTPS.<div< span="">itemscope itemtype="http://schema.org/Product"></div<>This is not the first time I have run into this issue. We also use MRSS schema for an RSS feed from yahoo and the same thing happens.<div< span="">xmlns:media="http://search.yahoo.com/mrss"></div<>The problem mainly lies in the fact that these schemas are not hosted over HTTPS. If you add HTTPS to the beginning of both you will get a security error.Just wondering if anyone else has dealt with this or similar issue and what the "best practices" are around this?Is it ok to obtain the schema directly and then host it on our server, over our secure connection?Thanks!
Intermediate & Advanced SEO | | AnthonyMangia0 -
Google Places / Google Analytics
I apologize first if this comes across as extremely novice, but I realized I really didn't know the answer and so - here I am. 🙂 Is anyone familiar with tracking google place traffic in google analytics? Is it possible? I'd love to know how many of our visitors are coming from our google place listings (we have several locations throughout the state.) Much gratitude in advance ~ Alicia
Intermediate & Advanced SEO | | Aaronetics0