Visualizing Neural Networks

https://photonlines.substack.com/p/grokking-neural-networks

by photon_lines • 3 years ago

100 14 3 years ago

photonlines.substack.com

Chris Olah has a similar but more in depth blog post like this: https://colah.github.io/posts/2014-03-NN-Manifolds-Topology/

photon_lines2• 3 years ago

Nice - thank you! Very informative post as well -- I love topology and this looks like a god-send!

RandomWorker• 3 years ago

This is basically week 3 of Andrew Ng neural networks and deep learning course on Coursera.

puttycat• 3 years ago

Off-topic: Substack's dark pattern attempts to maximize traction using intrusive pop-ups, text hiding, etc, is really awful. Such a text-hostile platform.

naillo• 3 years ago

Que substack becoming medium and 'stacksub' popping up with a new clean interface to take the users. Rinse and repeat and we never learn.

Terr_• 3 years ago

*Cue, a correction spurred by my own intrusively embarrassing memory of a Scrabble game misstep.

English also has "queue" (like a line of people or a certain hairstyle) but "que" generally means somebody is speaking Spanish.

Anyway, I hope that some future generations manage to figure out systems or incentives that avoid or delay that kind of mission decay.

svachalek• 3 years ago

Sadly you are observing the process of learning, it's just not the lesson you hoped they would take.

qudat• 3 years ago

I tried to capture this phenomenon in writing: https://bower.sh/bowers-law

rdedev• 3 years ago

Would it be better if substack has two forms of the same article? Like have the full article available only for paid members while having another one for someone just checking it out. Leave it to the author to decide what to show in a particular view.

Substack can restrict the size or types of content available in the free view of the article to reduce their server usage. I feel like this way the eventual enshittification could be delayed or even avoided. Of course this way might not be the best for getting YoY growth. And I'm not sure if any website provides such a provision

genter• 3 years ago

It's particularly nasty to have it popup when you've already read a couple paragraphs and are starting to get invested in it. At least Washington Post and NYTimes are upfront with their barrier.

jwilber• 3 years ago

Here’s a visual, interactive explanation with d3:

https://mlu-explain.github.io/neural-networks/

samsartor• 3 years ago

A while back I made a video along these lines, if anyone wants to see it animated: https://youtu.be/CfAL_cL3SGQ?si=tPnCzBjI0QVOpwCQ

photon_lines2• 3 years ago

Great video - thank you for this!!

alok-g• 3 years ago

Those interested in the topic may check my video here:

https://m.youtube.com/watch?v=B3NuJt6ttOI

It's much more visual and easy-going. I created it upon finding that several software developers were unable to understand in spite of many resources already available on the topic.

Visualizing Neural Networks

Related Stories