Perplexity is a useful metric to evaluate models in Natural Language Processing (NLP). This article will cover the two ways in which it is normally defined and the intuitions behind them. A language…
What is the information storage capacity of Earth, and how full is it today? The answer tells us surprising things about the growth of order in the universe