Perplexity is a useful metric to evaluate models in Natural Language Processing (NLP). This article will cover the two ways in which it is normally defined and the intuitions behind them. A language…
What is the information storage capacity of Earth, and how full is it today? The answer tells us surprising things about the growth of order in the universe
Y. Zhou, L. Wu, F. Weng, and H. Schmidt. Proceedings of the 2003 conference on Empirical methods in natural language processing, page 153--159. Morristown, NJ, USA, Association for Computational Linguistics, (2003)