Agreed! A lot of material out there is like the "how to draw and owl" meme: https://imgur.com/gallery/RadSf - start with bandits and now do DDPG.
The goal is for this course to provide the foundations for whatever folks want to do in RL after. It starts with bandits but then covers things like TD, Sarsa, Dyna, etc. in the tabular setting. Then folks learn about more advanced topics like linear and non-linear function approximation (read - linear e.g. Tile Coding, non-linear e.g. neural nets/deep rl).
This very much follows the intro RL course taught by Martha/Adam/Rich at the U of A, and follows Rich's textbook really closely.