How Large Language Models Use Probabilities to Choose Words and Phrases
Explore how Large Language Models use conditional probability, softmax functions, and decoding strategies like top-p and temperature to choose words. Learn why this statistical approach leads to both impressive creativity and occasional hallucinations.