Can extra capacity memorize the exception?
Train two local networks on the same 25 points. One sample is deliberately poisoned; nearby controls reveal how narrow the learned exception becomes.
BASE LABEL POISONED CANARY NEARBY PROBE
Train two local networks on the same 25 points. One sample is deliberately poisoned; nearby controls reveal how narrow the learned exception becomes.
The larger network learned a narrow exception around the exact canary while two nearby controls stayed near zero. That is evidence of memorization susceptibility in this controlled dataset.