AI PAPERS/DAILY
Subscribe free Open sourceView on GitHub Star This project is open sourceRead the code or use it in your own project. If you like it, don’t forget to give it a ★ star on GitHub.
Etsy
Evaluation

Reducing experiment duration with predicted control variates

Our short summary of Etsy’s engineering write-up. The full story, with all the detail, is on their blog.

Read the full write-up on etsy.com (opens in a new tab)

Problem

Experiments took too long, slowing product improvements.

Solution

They added predicted control variates to their A/B testing platform, cutting metric variance and shortening experiment time.

Average experiment duration reduced by 3 days

+ Suggest a write-up

Want the architecture, code and numbers? They’re in the original post.

Read the full write-up on etsy.com (opens in a new tab)

More from Evaluation

All Evaluation write-ups