Technique
Knowledge-augmented generation (KAG)
Answering from a knowledge graph of entities and relations, for multi-step reasoning.
What should you learn before KAG?
- ChunkingSplitting documents into passages sized for embedding and retrieval.
- EmbeddingsLists of numbers that place similar meanings close together, used for search and clustering.
- Tokens and tokenizationSplitting text into the units a language model reads and is billed by.
- TransformersThe attention-based neural network architecture behind modern language models.
- Large language models (LLMs)Transformer models trained on large amounts of text to predict the next token.
- Vector search and retrievalFinding the stored embeddings closest to a query, usually with an approximate index.
- Retrieval-augmented generation (RAG)Fetching relevant passages from your documents and giving them to the model with the question.
Connections to other concepts
- Uses
- Knowledge graphs