HN user
How do the organisers keep the private test set private? Does openAI hand them the model for testing?
If they use a model API, then surely OpenAI has access to the private test set questions and can include it in the next round of training?
(I am sure I am missing something.)
It seems like the best way of figuring out how strong a new model is, is to look at the benchmarks published by a 3rd competitor.
Want to know how well the new Google model performs compared to GPT-4? Look at the Claude benchmark table.
When doing these rent vs buy comparisons people often neglect the opportunity cost of investing the down payment and any difference between rent and mortgage (if it exists)
Rule of thumb according to [0] is that, assuming historical returns, if your yearly rent is less than 5%
(1% maintenance + 1% property tax + 3% capital cost vs investing)
of the property value it's better* to rent.
[0] https://youtu.be/Uwl3-jBNEd4?si=FDRG-6U_T4nsGtJa
*local tax treatment might play a role
**paying a mortgage requires less discipline than consistently investing during volatile markets
***Purely from a financial, non-emotional standpoint
****you might not be able to rent the house you want to buy
"Chance favors the prepared mind" - Louis Pasteur
"Beware the quiet man. For while others speak, he watched. And while others act, he plans. And when they finally rest...he strikes" - Anonymous
"Anxiety is the dizziness of freedom." - Kierkegaard
"We don't rise to the level of our expectations, we fall to the level of our training." - Archilochus
(from memory)