It only predicts the next word
There's no master plan: the model computes probabilities for the next word, picks one, and starts again. Chain thousands of these decisions and you get answers that look thought-out.
05 Lab
Watch AI think
A language model does just one thing: calculate which word comes next. Play with the probabilities, move the temperature and watch it decide live.
Pick a scenario
The sky is ___
Probability of the next word
blue 55.0%
cloudy 22.0%
clear 12.0%
gray 8.0%
green 3.0%
0.7
01
What you just saw
Temperature isn't magic
It's a mathematical operation that spreads or concentrates probability before rolling the dice. We use the real formula here: each bar is raised to 1/T and renormalized.
This is how hallucinations are born
When temperature rises, unlikely options gain ground. If one gets picked, the model will continue it with full confidence, as if it were true.
02