Geometric mean
The nth root of a product of n numbers. Here, e to the power minus the loss gives the geometric mean of the probabilities the model assigned to the correct tokens, so a loss of 0.69 means about 0.5.
The nth root of a product of n numbers. Here, e to the power minus the loss gives the geometric mean of the probabilities the model assigned to the correct tokens, so a loss of 0.69 means about 0.5.