Abstract
A mathematical framework analyzing Transformers as interacting particle systems reveals the emergence of clusters over time.
Generated by Qwen/Qwen2.5-Coder-32B-Instruct
Transformers play a central role in the inner workings of large language models. We develop a mathematical framework for analyzing Transformers based on their interpretation as interacting particle systems, which reveals that clusters emerge in long time. Our study explores the underlying theory and offers new perspectives for mathematicians as well as computer scientists.
Get this paper in your agent:
hf papers read 2312.10794 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2312.10794 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2312.10794 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2312.10794 in a Space README.md to link it from this page.