Concept
Sampling and temperature
How a model picks the next token, and how temperature and top-p change the output.
Part of LLM inference and costSampling and temperature
Connections to other concepts
- Part of
- LLM inference and cost
Practise Sampling and temperature
- Generative AI Interview Questions for Freshers1 question on Sampling and temperature
- Softmax with TemperatureCoding problem · medium