Perplexity

e raised to the loss, read as 'as unsure as choosing among N equally likely tokens'. The bigram model's loss of 2.49 is about 12.