How to hold a variable constant for an A/B test
-
For example, let's say you want to A/B test a title tag change. You are hoping to identify whether a title tag change increases CTR. But, position is always fluctuating a bit and that affects CTR, too. So, I'm interested in how you could hold position constant in order to isolate the change in CTR that is due to the title tag change. Does anyone know of resources/tools/tutorials for how to do this?
It's been... a very long time since I took statistics (-: I have access to Excel, MS Access, and R studio.
-
Thanks for the reply. I'll check out the links you included.
I thought it might be helpful to show an example of what got me thinking along these lines. This is a study about A/B testing of title tag changes. They don't say they accounted for position fluctuation; maybe they didn't, but it seems like you'd have to in order to have meaningful results.
-
I don't see a way of doing this accurately. With organic rank fluctuations, seasonality, competition it's near impossible to "hold" a position. However, if you have a position in serps for a specific keyword with little fluctuation and get decent traffic you can establish this as your baseline. Once the title is updated and appears in the serps, begin monitoring w/search console, analytics or etc. and see if you see any decent jumps. Some links for additional information: Finding the ROI of Title tag changes using Google's CausalImpact R package, SEO Split Testing & A Beginner’s Guide to A/B Testing: Effective SEO Landing Pages. Would love to hear if anyone else has a better way.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Staging/Development Site Indexed?
So, my company's site has been pretty tough to try to get moving in the right direction on Google's SERPs. I had believed that it was mainly due to having a shortage of back links and a horrible home page load time. Everything else seems to be set up pretty well. I was messing around and used the site: Google search operator for our staging site. I found stage.site.com and a lot of our other staging pages in the search results. I have to think that this is the problem and causing a duplicate content penalty of the entire site. I guess I now need to 301 redirect the entire site? Has anyone every had this issue before and have fixed it? Thanks for any help.
Intermediate & Advanced SEO | | aua0 -
Drop in Ranking for a Reputable Dictionary / April 14, 2017
One of the sites of my customers (a very reputable, high quality dictionary) saw a 46% drop in rankings starting from April 14, 2017. Has anyone else seen something similar and has some tips? Many thanks, Tatiana
Intermediate & Advanced SEO | | lascribacchina0 -
A/B Testing - Should I add product descriptions on my category landing pages as well as on product pages and if so . how to do this to avoid duplicate content
Hi All, I recently relaunched a new design on my tool hire eCommerce website and now display my products in grid form on my category landing pages as opposed to just a list view which we previously had on the old design. My bounce rates are alot higher than they use to be and my gut instinct is telling me maybe this is wrong . I want to do some a/b testing using a list view. My question is , previously in our list views we just showed the images and pricing and had on page content on the bottom of the page. The user would click on the product image and they would then we taken to the product page which has the product description , t&c, etc etc.. If I was to do this in my a/b testing but change it so we also displayed the product descriptions as well on the category landing pages . Is there a special way to do this as in effect, we would have duplicate content as the product descriptions are also on the product page?. Does anyone have any thoughts on this as to whether its a No No from an SEO point of view ?... Heres a short url link to one of my category pages - http://goo.gl/QJv5gw Historically we use to rank well for the category landing pages and not for the product pages.Our Rankings are down , bounce rates are higher so I am trying to sort both. We have good content on pages etc. Any advice greatly appreciated as always thanks Pete
Intermediate & Advanced SEO | | PeteC120 -
Showing on page 25 for url keyword/ brand, is it a penalty?
Hi I have a site which shows on page 25 in G serps for the main brand keyword which is also the url its a .com and as far as I can see has no penalties and has unique content. The keyword itself has no competition and the site should be no1 in G for it. Our site domain is 11 years old.
Intermediate & Advanced SEO | | MoneySite0 -
Rankings Drop since Humingbird - Could it be my link ratio between .co.uk / .com ?
Hi All, I have an UK tool hire eccomerce muliti location website with different locations pages for each category. My stratedgy has been to specialise on local search for each location as oppose to try and compete with highly competitive keywords on a national level. I do have some duplicate/ thin content issues on these location pages but I've been actively writting additional unique content on these pages to address this issue which also making sure my title tags, h1 , h2 tags etc are unique for each location along with having individual google local + pages etc etc. I have never previously been affected by any duplicate contents issues and always ranked first page (mainly top 5) for most of my local keywords). However, when google humingbird update came out , I suffered approx 25% drop in traffic and rankings. rom what I read , local search sites have suffered somewhat in this update and I did a link detox report to try and asterain toxic links etc. I found a few which I disavowled but I have had no manul penalty message in my GWT so I can only assume I was affected by an google algorithmic penalty. From looking at opensite explorer , I can see my link ratio for my .co.uk site shows 43% .com 37% .co.uk I am wondering if it could be this which has been the cause of my local rankings to fail ?. Has anyone else suffered the same as I am at my witts end as to what are the likely factors which could have caused such a drop ? Any tips, greatly appreciated. Happy to give my sites url if anyone would like to take a look ? thanks Sarah.
Intermediate & Advanced SEO | | SarahCollins0 -
Site Interlinking - footer and menu - whether to nofollow/remove
Hello, We've got a bunch of interlinking going on between the following sites: nlpca(dot)com thewealthymind(dot)com shop.nlpca(dot)com dynamicspinrelease(dot)com These are all owned and operated by the same people. Some linking is in the footer and some is in the menu or header. Could you take a look and tell me which interlinks you'd recommend nofollowing and which you'd recommend deleting entirely? We can always place a home page single link to replace those sitewides we delete or nofollow. I'm thinking we should delete everything in the footers and nofollow those in the menu or headers, placing a single dofollow link on the home page when deleting/nofollowing a sitewide link.
Intermediate & Advanced SEO | | BobGW0 -
Google's Structured Data Testing Tool? No Data
I'm stumped as to why some of the pages on my website return no data from Google's Structured Data Testing Tool while other pages work fine and return the appropriate data. My home page http://www.parkseo.net returns no data while many inner pages do. http://www.parkseo.net Returns No Data http://www.parkseo.net/citation-submission.html Does Return Data. I have racked my brains out trying to figure out why some pages return data and others don't. Any help on this issue would be greatly appricated. Cheers!
Intermediate & Advanced SEO | | YMD
Gary Downey0 -
Does Google Index an Alert Div w/Delayed Hide
We have a div at the top of a client's the page that displays an alert to the user. After 30 seconds it is rendered hidden. Does Google index this? Does Google take this into account when it ranks the page?
Intermediate & Advanced SEO | | WEOMedia0