Relative cost curves: an alternative to AUC and an extension to 3-class problem

Title:

Relative cost curves: an alternative to AUC and an extension to 3-class problem

Creator:

Montvida, Olga and Klawonn, Frank

Identifier:

https://cdk.lib.cas.cz/client/handle/uuid:cb255c9f-a125-4f9a-baef-94e9759322f1
uuid:cb255c9f-a125-4f9a-baef-94e9759322f1

Subject:

classifier, performance evaluation, misclassification costs, cost curves, ROC curves, and AUC

Type:

model:article and TEXT

Format:

bez média and svazek

Description:

Performance evaluation of classifiers is a crucial step for selecting the best classifier or the best set of parameters for a classifier. Receiver Operating Characteristic (ROC) curves and Area Under the ROC Curve (AUC) are widely used to analyse performance of a classifier. However, the approach does not take into account that misclassification for different classes might have more or less serious consequences. On the other hand, it is often difficult to specify exactly the consequences or costs of misclassifications. This paper is devoted to Relative Cost Curves (RCC) - a graphical technique for visualising the performance of binary classifiers over the full range of possible relative misclassification costs. This curve provides helpful information to choose the best set of classifiers or to estimate misclassification costs if those are not known precisely. In this paper, the concept of Area Above the RCC (AAC) is introduced, a scalar measure of classifier performance under unequal misclassification costs problem. We also extend RCC to multicategory problems when misclassification costs depend only on the true class.

Language:

English

Rights:

http://creativecommons.org/publicdomain/mark/1.0/
policy:public

Coverage:

[647]-660

Source:

Kybernetika | 2014 Volume:50 | Number:5

Harvested from:

CDK

Metadata only:

false