To compute the perplexity numbers on the test data, our model doesn't take account of anything other than the log probabilities on word prediction.
To compute the perplexity numbers on the test data, our model only takes account of log probabilities on word prediction.