Shortcut Learning
Shortcut learning happens when a model solves the training task using an easy cue that is correlated with the label but not the intended concept. The model may look excellent on a test set drawn from the same source and fail badly when the shortcut disappears.
Examples include classifying pneumonia from hospital-specific image markers, identifying animals by background, or detecting sentiment from punctuation patterns instead of meaning.
Occlude the Background, Watch the Prediction
This wildlife classifier might be reading the scene instead of the bird. Pick a case, then toggle the background on and off to see whether the prediction depends on habitat rather than the animal.
🦆
on water
Model prediction
waterbird
true label: waterbird
Correct prediction
Shortcut analysis asks: What alternative rule could explain the model's success? Test by changing that cue while preserving the intended label. Swap backgrounds, mask metadata, rebalance sources, create counterfactual examples, or evaluate on a new collection environment.
Look for Too-Easy Signals
If performance is surprisingly high, ask whether the model found a path that would not be acceptable in deployment.
A bird classifier performs well until photos are cropped tightly around the bird. What shortcut might it have learned?