Sinusoidal positions
Also written: sinusoidal encoding, sinusoidal position encodings
Fixed position vectors built from sine and cosine waves of different speeds, as in the original transformer. They need no learning and can be computed for any position.