Attention head

Also written: head, heads

One of several smaller attention computations that run side by side in multi-head attention, each with its own queries, keys and values. Different heads can learn different jobs, such as looking at the previous character.