Lukas Vermeer

There are many pitfalls to avoid when running online experiments. In this presentation, Lukas will teach you one neat trick to run better experiments: the sample ratio mismatch check. Using this technique, you will make fewer mistakes, and make better decisions, while running experiments.

Booking.com has been conducting evidenced based product development using online experiments for more than fifteen years. Our methods and infrastructure were designed from their inception to reflect Booking.com culture, that is, with democratization and decentralization of experimentation and decision making in mind. In this talk, we explain how our approach has allowed such a large organization as Booking.com to truly and successfully democratize decision making.