April 5, 2007
Biznology Blog by Mike Moran
« Profiting from Impulsiveness | Main | Search Marketing Podcast »
Free Multivariate Testing
I've written before about multivariate testing, an emerging technique for rigorous analysis of just what persuades customers to convert. But some companies have been stopped in the past by the cost of licensing a multivariate testing tool. Yesterday, Google Website Optimizer, a multivariate testing tool, emerged from a restricted beta test and can be used by any Google AdWords advertiser for free.
Now, understand, the tool is free, but multivariate testing still costs you time and effort that you'd be spending on other things. You must take the time to develop multiple versions of your content and you must load up the page with some JavaScript and run and monitor the experiment. You can check out Google's multivariate testing instructions to gauge the effort required.
The effort is worth it. At last October's Emetrics Summit, Regis Hadiaris, the Director of Web Marketing for Quicken Loans, said that the use of multivariate testing has increased revenue 30 percent per year every year. ReallyGreatRate's case study is also persuasive. You ought to be testing variations to improve your site anyway—multivariate testing is just a better way to do it.
Just as when Google began offering a free Web traffic metrics service, Google Analytics, some folks have questioned whether marketers should allow Google access to this highly-valuable marketing information. Andrew Goodman, in particular, has written persuasively about this "fox in the hen house" situation where a company you buy advertising with knows how much you sell and what it is about your site that sells it.
For small businesses, "free" is more important than data privacy, but larger marketers might be better off using Optimost or another licensed multivariate tool that protects the privacy of their testing data, just as they might use CoreMetrics or another fee-based analytics tool to protect traffic and conversion data.
Regardless of the data sharing issues, your company ought to be using multivariate testing to optimize your customer conversions. And if the cost of a licensed tool seemed too formidable before, now you have no excuse. Google Website Optimizer makes that free.
Posted by mikemoran at April 5, 2007 8:33 AM
Trackback Pings
TrackBack URL for this entry:
http://www.mikemoran.com/mt/mt-tb.cgi/221
Comments
Mike, I wanted to let your readers know that we are offering seven free resources to support Google Website Optimizer at http://www.grokdotcom.com/googlewebsiteoptimizer/
Posted by: Jeffrey Eisenberg at April 6, 2007 1:15 PM
Thanks, Jeffrey, those are great resources. By the way, if there is anyone left who doesn't subscribe to FutureNow's blog, you really ought to: http://www.grokdotcom.com/
Posted by: Mike Moran at April 6, 2007 8:22 PM
Mike, I wanted to let your readers know two minor points of clarification:
1. I'm a Team Leader at Quicken Loans, responsible for Website Marketing's daily operations and testing, but not the Director of Website Marketing - that's someone else ;-)
2. My actual statement was "What if you could walk into your CMO's office and confidently say I can show you how to grow revenue by 30% - are you interested?" We have seen significant improvement in several of our key metrics because of multi-variable testing, but a 30% growth in revenue every year is not quite accurate.
I do appreciate you getting the word out about multi-variable testing and how Google Optimizer can help those who do not have the budget for the more costly MVT services. If you'd ever like to talk more about MVT, where we see it going, etc. just let me know!
Posted by: Regis at April 27, 2007 2:05 PM
by "an emerging technique" do you mean a technique that predates the internet? If so you are correct.
Posted by: Klyde Beattie at March 17, 2008 3:26 AM
Klyde,
Certainly, Taguchi testing predates the Internet (which I point out in the post that I linked to at the top of this article), but MVT is emerging as a very powerful way to use computers to analyze something that few people did just a few years ago. It's been almost a year since I called MVT "emerging," but it's something that most companies still don't do, so help me spread the word.
Mike
Posted by: Mike Moran at March 17, 2008 4:20 AM
