Inputs and targets
Also written: x and y, targets
The training pair cut from text: a window of tokens is the input, and the same window shifted one place to the right gives the target, so every position's answer is the next token.
Also written: x and y, targets
The training pair cut from text: a window of tokens is the input, and the same window shifted one place to the right gives the target, so every position's answer is the next token.