The Reformer – Pushing the limits of language modeling 6 years ago
IMO the theoretical insight w.r.t. transformers as RNNs through the kernel formulation of self-attention is more interesting than the experimental results.
joeddav
Posts0
Comments1
No posts found.