HNGlance

Top Best New Show

Traveling words: a geometric interpretation of transformers

https://arxiv.org/abs/2309.07315

by d4rkp4ttern • 3 years ago

80 4 3 years ago

AR

Related Stories

Loading related stories...

Comments

4

dleeftink• 3 years ago

I like this definition. Simple, clean, effective.

Maybe the start of a new field tackling 'travelling wordsman' (smith?) problems.

dpflan• 3 years ago

To anyone knowledgeable: where does geometric deep learning fit in here? Is this paper just another geometric view, or is it an attempt at a formalization for transformer mathematics? I don't see prominent GDL authors in this paper's references (Bronstein, Cohen, Bruna, Veličković, ...).

esafak• 3 years ago

Geometric learning is more about group- and invariant theory. This paper only goes as far as linear algebra, as far as I see.

uoaei• 3 years ago

I think it could be applicable to developing a novel geometric theory if the dynamics of the word trajectories were better understood.

Source preview

arxiv.org

HNGlance

© 2024-2026 HN Glance. Story content belongs to its original sources.

Privacy
Terms