When uncertainty quantification fails: structural vulnerabilities and corrections for selective prediction under clinical class imbalance
Аннотация
Background Selective prediction systems improve the safety of clinical artificial intelligence by deferring ambiguous cases to human experts while automating high-confidence decisions. However, this safety mechanism relies entirely on the premise that uncertainty scores accurately reflect clinical ambiguity. In prognostic tasks characterized by severe class imbalance, where the clinical outcome of interest is a minority, this assumption breaks down. Standard uncertainty measures cease to capture clinically aligned ambiguity; instead, they become a proxy for class membership, systematically penalizing minority patients regardless of their individual predictive clarity. Methods We characterize three structural failure modes driving this breakdown: the mismatch between standard entropy’s mathematical peak and the clinical decision threshold; the asymmetric spatial penalty in margin-based uncertainty; and structural uncertainty divergence of minority predictions driven by data scarcity. We propose three counter-mechanisms: an empirically validated threshold-aware ambiguity score that realigns maximum uncertainty with the clinical threshold, a class-conditioned rejection (CCR) mechanism ranking patients within their predicted trajectory rather than globally, and a class-stratified evaluation metric that prevents global risk scores from concealing automated minority exclusion. Results Across 56 synthetic conditions and three neurodegenerative cohorts spanning severe class imbalance to near-balanced conditions (multiple sclerosis, Parkinson’s Disease, Alzheimer’s Disease), our framework consistently maintained bounded, balanced risk across trajectories. In contrast, global metrics either collapsed minority Sensitivity or protected the minority at the expense of majority patients. An ablation study confirmed that applying CCR with standard entropy fails to protect the minority because it breaks within-class monotonicity when $$\tau \neq 0.5$$ . Combining CCR with threshold-aware metrics restores strict monotonicity, correctly identifies ambiguous patients, and safely mitigates minority exclusion. Conclusions Under clinical class imbalance, standard uncertainty quantification measures dataset sparsity rather than clinical ambiguity, creating a systemic illusion of safety. This bias is a correctable structural flaw. Clinical pipelines deploying selective prediction under imbalance should adopt threshold-aligned uncertainty measures and class-stratified evaluation. This reduces class-specific risk imbalance, supporting safer selective prediction under the evaluated conditions without silently excluding the most vulnerable patients.