learn deep. ship safe.Practice testsFollow ByteMunSubscribe

Concept

Small language models (SLMs)

Compact language models that are cheaper and faster, often fine-tuned for one job.

Concept map
Learn firstLLMs
SLMsCompared withLLMs

What should you learn before SLMs?

  1. Deep learningMachine learning with many-layered neural networks.
  2. Tokens and tokenizationSplitting text into the units a language model reads and is billed by.
  3. TransformersThe attention-based neural network architecture behind modern language models.
  4. Large language models (LLMs)Transformer models trained on large amounts of text to predict the next token.

Connections to other concepts

Compared with
LLMs

Read and watch: SLMs explained

All topics