learn deep. ship safe.Practice testsFollow ByteMunSubscribe

Concept

Overfitting

A model learning noise in the training data, so it does well in training and badly on new data.

Concept map
Overfitting
Then learnRegularization

What should you learn before Overfitting?

  1. Feature engineeringTurning raw data into inputs a model can learn from: scaling, encoding and new features.
  2. Machine learningBuilding systems that learn patterns from data instead of following hand-written rules.
  3. Supervised learningLearning from labelled examples to predict a label or value.
  4. Model evaluation and metricsYou spot overfitting by comparing training and test scores.

What to learn after Overfitting

  • RegularizationPenalising model complexity (L1, L2, dropout) to reduce overfitting.

Connections to other concepts

Reduced by
Regularization

Practise Overfitting

All topics