In the Eyeball/Blackbox approach, the Blackbox dev set is checked manually during routine error analysis.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Overfitting a development set used for model tuning
What most clearly indicates that a manually inspected dev slice has been over-tuned during error analysis?
Inspecting a manually reviewed validation set can make you adapt to that set more quickly than if you never looked at its examples.
Keeping a Reviewed Subset Separate from a Hidden Check Set
Match each validation-set concept to its description in a reviewed-vs-reserved split.
Order the steps for checking whether repeated manual review is causing overfitting to a reviewed validation subset.
What is the most likely conclusion when manual review keeps pushing one dev set score far above another?
If the Eyeball dev set improves much faster than the Blackbox dev set, you have _____ the Eyeball dev set.
Match each performance pattern with the most appropriate interpretation when comparing a hand-reviewed set with a separate hidden set.
Order the steps for checking whether a manually reviewed dev set has been overfit.
Detect Overfitting to an Inspected Development Set
When Manual Review Improves Faster Than a Hidden Evaluation Set
Why split the validation set into reviewed and unreviewed parts?