Learn Before
What does “worse” mean in an informal variance comparison?
Question: In an informal comparison of training and validation or test performance, what does it mean when one side is described as worse, and which result is used as the baseline?
Sample answer: It means the validation or test performance is poorer than the training performance. Training performance is the reference point used to judge how much the model has degraded.
Key points:
- The worse result is usually on the validation or test set.
- Training performance is the comparison baseline.
Rubric: Credit answers that identify validation or test as worse than training and state that training is the reference used for the comparison.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What does variance mean in this informal comparison?
A larger performance gap between training data and validation data is an informal sign of variance.
Variance compares test performance to the ____ performance.
Match each term to its role in the informal variance idea.
Order the steps for judging whether a model has high variance
Why does the informal idea of variance require a comparison between training and held-out results?
Interpret a gap between training and validation performance.
What information is needed to judge variance informally?
An informal variance score is defined as training-set error minus test-set error.
A Big Gap Between Training and Development Error Suggests Overfitting