deepseek drop was based on assumption that we overestimated how much compute and infra is needed to train models. They seem to have claimed that they did it in couple of million or something.
we have tons of street festivals in chicago in summer but now they have lost been outsourced to festival companies and subsequently lost all charm and local feel.
They are all copy paste of each other and outright scams.
how do you make sure they have some charecter and dont turn into mc-festival
I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles.
For sure. You cannot have "only higher level thoughts" without doing lower level work.
Ironically llm themselves prove that because you cannot remove facts like 'paris is capital of france' from llm and have it just retain 'high level thoughts' like 'countries have capitals that you can look up'