Topics
254 programming, AI and security concepts, each with a one-line definition, what to learn first and where to practise it.
Showing 25–48 of 60 in AI & Machine Learning · Clear filters
Neural networks
Layers of weighted connections trained by backpropagation to learn patterns.
2 articlesQuantum computing
Computing with qubits, which use superposition and entanglement for certain problems.
2 articlesReinforcement learning
Learning by trial and error from rewards.
2 articlesReverse engineering
Working out how a product or program works by taking it apart and observing it.
2 articlesSmall language models (SLMs)
Compact language models that are cheaper and faster, often fine-tuned for one job.
2 articlesEnsemble methods
Combining several models, such as random forests and gradient boosting.
5 practice questionsLLM evaluation
Testing language-model output with test sets, rubrics and model-graded checks.
5 practice questionsBias–variance trade-off
The balance between a model that is too simple and one that is too sensitive to its training data.
4 practice questionsCaching
Keeping copies of results closer to where they are needed so they are served faster.
1 article · 1 practice questionHallucination
A model stating something false with confidence.
4 practice questionsOptimization and gradient descent
Adjusting model parameters step by step to reduce a loss.
4 practice questionsRegularization
Penalising model complexity (L1, L2, dropout) to reduce overfitting.
4 practice questionsAI system design
Architecting LLM applications: serving, retrieval, caching, guardrails and scaling.
1 articleArtificial general intelligence (AGI)
A hypothetical AI able to learn and perform most intellectual tasks a person can.
1 articleCache-augmented generation (CAG)
Loading a fixed knowledge set into the model's context and cache instead of retrieving per question.
1 articleGemini
Google's family of AI models.
1 articleHow LLMs are trained
The pipeline from data and tokenization through pre-training to fine-tuning and preference tuning.
1 articleImbalanced data
Datasets where one class is rare, and the techniques and metrics that handle them.
3 practice questionsKnowledge graphs
Data stored as entities and the typed relationships between them.
1 articleKnowledge-augmented generation (KAG)
Answering from a knowledge graph of entities and relations, for multi-step reasoning.
1 articleLangChain
A framework for composing LLM calls, retrieval and tools into applications.
1 articlePyTorch
A Python framework for building and training neural networks.
1 articleReward hacking
An AI system satisfying the letter of its reward while missing what was intended.
1 articleChunking
Splitting documents into passages sized for embedding and retrieval.
2 practice questions