HN user

5kg

149 karma
Posts3
Comments34
View on HN
Racket v9.1 5 months ago

The Little Learner is a great book. I tried rewriting all the code in Python/JAX while following the Scheme code style as closely as possible, and it worked out great.

The appendix on autodiff is a bit rushed, in my opinion. But in all fairness, the number of pages would probably need to be doubled to give a proper exposition of autodiff.

I'd love to see someone who has the resources train a model bigger than 2.8b and show the scaling law still holds.