A language model is a probability distribution over phrases or word sequences. In practice, it gives the probability of a certain term sequence remaining “legitimate.” Validity in this context does not make reference to grammatical validity. Alternatively, it signifies that it resembles how men and