Ramesh Johari, Virag Shah, and myself wrote an academic paper on “large scale experimentation” that introduces a framework on how to think about optimal testing when there are a lot of possible experiments to run.

To accompany the more technical academic paper, I wrote a blog post with a more intuitive exposition of the main ideas for the Multithreaded blog.

My favorite aspect of this blog post is the interactive visualization by Brian Coffey where the reader is encouraged to explore different testing strategies.