Ask HN: How do you distill a frontier model?
https://news.ycombinator.com/item?id=42871105Is it just obtaining a distribution of the next token predictions, or is it more complex?
Is it just obtaining a distribution of the next token predictions, or is it more complex?