Encoder, decoder
Also written: encoder, decoder, encoder-decoder
Whisper's two model parts. The encoder reads a whole 30-second window and turns it into vectors, and the decoder writes the text tokens one at a time.
Also written: encoder, decoder, encoder-decoder
Whisper's two model parts. The encoder reads a whole 30-second window and turns it into vectors, and the decoder writes the text tokens one at a time.