attention-is-all-you-need
2 posts on attention-is-all-you-need, newest first.
2posts
2024first post
- 7 min read
Attention Is All You Need: Key Terms in English & Chinese
A glossary of Transformer terms from "Attention Is All You Need" (Q/K/V, multi-head attention, positional encoding, BLEU) with Chinese translations.
- 5 min read
Attention Is All You Need Abstract Explained (Day 1)
The abstract of “Attention Is All You Need” (Vaswani et al., 2017) makes one bold claim. You can build a sequence-to-sequence model out of attention alone, with no recurrence and no convolution, and…