Evaluation
The Causality Gap: Measuring the True Impact of Voluntary Adoption in Digital Marketplaces
Our short summary of Booking.com’s engineering write-up. The full story, with all the detail, is on their blog.
Read the full write-up on booking.ai (opens in a new tab)Problem
Users and partners chose whether to use new features, making it hard to see the real effect of those features.
Solution
They ran a Randomized Encouragement Design and applied Double Machine Learning to separate the impact on people who adopted the feature from the overall rollout effect, revealing where to improve the product or the adoption funnel.
Want the architecture, code and numbers? They’re in the original post.
Read the full write-up on booking.ai (opens in a new tab)
PostHog