HNGlance

Top Best New Show

Experiment Interpretation and Extrapolation

https://tecunningham.github.io/posts/2023-04-18-netflix-cider-experimentation-note.html

by tartakovsky • 3 years ago

2 1 3 years ago

TE

tecunningham.github.io

Related Stories

Loading related stories...

Comments

1

tartakovsky• 3 years ago

The webpage discusses a Bayesian approach to experimentation, focusing on interpreting and extrapolating experimental results, mainly in a tech environment aiming to maximize user retention. It addresses challenges like the inference problem, the extrapolation problem, the explore-exploit problem, and a culture problem within tech companies around misuse of experiments. The author suggests providing decision-makers with benchmark statistics to help them estimate true effects of different policies, and discusses a model of experimentation dealing with observed and true effects along with the noise in experiments 1 .

Source preview

tecunningham.github.io

HNGlance

© 2024-2026 HN Glance. Story content belongs to its original sources.

Privacy
Terms