Convince your boss with results from actual A/B split and MVT tests.
How to find real-life examples of A/B tests.
Top 5 most frequent A/B tested sites
Sears, Skype, Monster, Amazon.com, H&R block, T-Mobile, IBM, Citi, MS Live Search Maps, esurance, Disney (here)
No. 2 online retailer Office Depot (Forrester 2006)
Check out the clients/references/testimonials of big players on the testing market.
On the other scale, compared to Amazon e.g. eBay (great filtering, but too many links on category pages, also poor product page) overdose the “listening to the user” research (source @ 19mins). The best is mid-way.
Real-life conversion case studies
http://visualwebsiteoptimizer.com/ideafox.php (search engine that searches http://www.avangate.com/clients/case-studies/ , and many more…) TIP
[my Rollyo/GSE search engine here]
http://visualwebsiteoptimizer.com/split-testing-blog/how-replacedirect-used-ab-testing-to-reduce-cart-abandonment-by-25/ Most important, they added a product overview and removed redundancy
Google: (keywords, e.g. navigation removed check-out) (case OR) found OR results converted OR conversion OR optimized OR optimization (OR “A/B” OR MVT)
(websites and blogs dedicated to testing and optimization):
- http://www.marketingexperiments.com/blog/category/research-topics/landing-page-optimization-research-topics (Marketing Experiments blog, a bit harder to find actual results) +
- http://www.grokdotcom.com/ +-
- http://www.marketingsherpa.com/ have some of the best marketing data
- http://www.uxbooth.com/ +
- unbounce.com (NV)
More @ http://www.seoptimise.com/blog/2010/07/30-multivariate-ab-split-testing-tools-tutorials-resources.html (see ‘Case studies’)
Directory of more web resources
…but still worth checking now and again
http://www.amazon.com/Landing-Page-Optimization-Definitive-Conversions/dp/0470174625/ref=pd_sim_b_7 (more about measuring and theory, rather than hands-on practical case studies)