HNGlance

Top Best New Show

Intuition and Implementations for Gated Linear Networks

https://aiwabdn.github.io/pygln/

by aiwabdn • 6 years ago

3 5 6 years ago

AI

aiwabdn.github.io

Related Stories

Loading related stories...

Comments

5

aiwabdn3• 6 years ago

This blog post details our interpretation of Gated Linear Networks, a new family of neural networks proposed by researchers at DeepMind. Implementations in JAX, NumPy, PyTorch and Tensorflow are here: https://github.com/aiwabdn/pygln

p1esk2• 6 years ago

What prevents you from scaling it up and achieving good results on Imagenet?

aiwabdn3• 6 years ago

Main reason for now is that the cosine similarity used as context function is not suitable for natural images like those in Imagenet. We are experimenting some extensions based on convolutions for such use cases.

Source preview

aiwabdn.github.io

HNGlance

© 2024-2026 HN Glance. Story content belongs to its original sources.

Privacy
Terms