Yes we do. If you write a speech and read it aloud then your written speech is a "statistical model of what word should go next". Any method of creating language can be expressed in this form.
(For text, you might want to go back and edit what you've already written, but that can be handled with a token that says to start over.)
(For text, you might want to go back and edit what you've already written, but that can be handled with a token that says to start over.)