Learn Before
Reducing Variance After Adding Diagnostic Features
Case context: A machine learning engineer reviews errors in a bank card fraud detector and finds that it misses a group of transactions with an unusual combination of merchant category and time-of-day patterns. To address that specific weakness, the engineer adds new engineered input features that highlight those patterns. The training error falls, but validation performance now shows a noticeable rise in variance.
Question: According to the standard approach for handling this tradeoff after improving bias with new features, what should the engineer do next to address the increased variance?
Sample answer: The engineer should apply regularization, which is the usual next step for reducing the variance that can appear after adding features intended to lower avoidable bias.
Key points:
- The added features were designed to reduce avoidable bias in a targeted error category.
- The side effect observed was an increase in variance.
- Regularization is the appropriate technique for counteracting that variance increase.
Rubric: The answer must correctly identify regularization as the needed intervention to address the rise in variance.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What should you do if adding new features raises variance?
Do Newly Added Inputs Affect Only One Source of Error?
Improving Features from _____ Findings
Roles in Adding New Features
Steps for Adding a New Feature After Error Review
Why Extra Features Can Backfire Temporarily
Purpose of New Inputs After Review
How Error Analysis Can Shape New Features
Regularization Can Offset Added Variance