ML Foundations: Understanding the Math Behind Backpropagation

https://jordancoblin.github.io/posts/understanding-the-math-behind-backpropagation/

by jcoblin • 2 years ago

4 2 2 years ago

jordancoblin.github.io

Well done. I'd change a few things to make things technically more precise. In a few places you use words like "learnable" parameter but I think this tends to confuse people more than help them understand what is going on. People can learn but parameters can only be modified according to some rule that minimizes or maximizes some objective function of those parameters. People who understand the technical details tend to use words/phrases like "learning" as shorthand but in an introductory post like this it is useful to be technically precise and not use anthropomorphisms that can confuse beginners.

jcoblin• 2 years ago

That's a great point. I tend to take for granted the intuition required for some of the terminology - best to keep it precise, as you suggest.

ML Foundations: Understanding the Math Behind Backpropagation

Related Stories