A model trained to predict the next word over a vast library of text, then tuned on examples and human preferences. Fluent is not the same as correct.

ExampleAsk the same question twice and get two different answers; when it doesn't know, it still sounds sure.