FlashAttention

A fast GPU implementation of attention that never stores the full T × T table of weights, saving large amounts of memory on long sequences.