The relations between number of units or frequency of units on the one hand and information on the other hand, follow, as it were, from the very definition of what information is. They are necessary and, should we say, automatic. If the frequency of an item decreases, its probability must necessarily decrease too, and nothing can prevent its information from soaring.
- Martinet (1962), a pag.143