<p>Instead of learning a mapping from instances to outcomes in the standard way, the key idea of pairwise difference learning (PDL) is to learn a function that takes two instances as input and predicts the difference between their respective outcomes. Given a function of this kind, predictions for a query instance are derived from every training example and then aggregated. We consider pairwise difference learning for classification (PDC) and propose two uncertainty quantification methods that faithfully represent and measure the classifier’s predictive uncertainty. Building on recent work on decomposing total uncertainty into aleatoric and epistemic components, we propose different ways of extending corresponding measures to the setting of PDC, depending on how and to what extent the underlying base learner represents uncertainty. In large-scale empirical studies, we analyze both the predictive accuracy and the uncertainty awareness of the methods.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Uncertainty Quantification in Pairwise Difference Learning for Classification

  • Mohamed Karim Belaid,
  • Maximilian Rabus,
  • Eyke Hüllermeier

摘要

Instead of learning a mapping from instances to outcomes in the standard way, the key idea of pairwise difference learning (PDL) is to learn a function that takes two instances as input and predicts the difference between their respective outcomes. Given a function of this kind, predictions for a query instance are derived from every training example and then aggregated. We consider pairwise difference learning for classification (PDC) and propose two uncertainty quantification methods that faithfully represent and measure the classifier’s predictive uncertainty. Building on recent work on decomposing total uncertainty into aleatoric and epistemic components, we propose different ways of extending corresponding measures to the setting of PDC, depending on how and to what extent the underlying base learner represents uncertainty. In large-scale empirical studies, we analyze both the predictive accuracy and the uncertainty awareness of the methods.