Researcher
Ashish Vaswani
Papers
-
Attention Is All You Need
"Attention is all you need": an architecture built purely from self-attention and feed-forward layers, no recurrence or convolution. Parallelizable and scalable, it became the substrate for BERT, GPT, and essentially all modern large language models.
arxiv.org ↗