Glossary: Computer Vision Beyond the Basics

Attention

The key layer of a transformer: it lets every item in a sequence (such as an image patch) look at every other item and decide which ones matter to it.