TinyStories: How Small Can Language Models Be and Still Speak Coherent English? (2023) 2 years ago
Trained a GPT-2 like model on the dataset a while back, here's the source code and some results for anyone interested:
HN user
Trained a GPT-2 like model on the dataset a while back, here's the source code and some results for anyone interested: