Using AUC and accuracy in evaluating learning algorithms

J Huang, CX Ling - IEEE Transactions on knowledge and Data …, 2005 - ieeexplore.ieee.org
AUC is a better measure (defined precisely) than accuracy. We then reevaluate well-established
claims in machine learning based on accuracy using AUC … decision trees in AUC. The …

AUC: a misleading measure of the performance of predictive distribution models

JM Lobo, A Jiménez‐Valverde… - Global ecology and …, 2008 - Wiley Online Library
… (ROC) curve, known as the AUC, is currently considered to be the … We do not recommend
using AUC for five reasons: (1) it … the rate of well‐predicted absences and the AUC scores. …

AUC: a better measure than accuracy in comparing learning algorithms

CX Ling, J Huang, H Zhang - Conference of the canadian society for …, 2003 - Springer
… than accuracy, we substitute f by AUC and g by accuracy in the definition above. To simplify
our notation, we will use AUC to represent AUC values, and acc for accuracy. The domain Ψ …

[PDF][PDF] AUC: a statistically consistent and more discriminating measure than accuracy

CX Ling, J Huang, H Zhang - Ijcai, 2003 - cs.unb.ca
AUC, has been proposed as an alternative single-number measure for evaluating learning
algorithms. In this paper, we prove that AUC … proof to establish that AUC is indeed statistically …

Efficient AUC optimization for classification

T Calders, S Jaroszewicz - European conference on principles of data …, 2007 - Springer
In this paper we show an efficient method for inducing classifiers that directly optimize the
area under the ROC curve. Recently, AUC gained importance in the classification community …

AUC maximization in the era of big data and AI: A survey

T Yang, Y Ying - ACM computing surveys, 2022 - dl.acm.org
… for AUC and AUC estimators in Section 2. We give definitions for both AUC and partial AUC
and … In Section 3, we review different objective functions for AUC maximization and mainly dis…

Model selection via the AUC

S Rosset - Proceedings of the twenty-first international conference …, 2004 - dl.acm.org
… tests for the difference between AUC scores of two algorithms on … AUC to empirical
misclassification error when the prediction goal is to minimize future error rate. We show that the …

AUC optimization vs. error rate minimization

C Cortes, M Mohri - Advances in neural information …, 2003 - proceedings.neurips.cc
… the AUC and the error rate, including the first exact expression of the expected value and
the variance of the AUC for a fixed error rate. Our results show that the average AUC is …

The open AUC project

H Cölfen, TM Laue, W Wohlleben, K Schilling… - European Biophysics …, 2010 - Springer
Progress in analytical ultracentrifugation (AUC) has been hindered by obstructions to hardware
innovation and by software incompatibility. In this paper, we announce and outline the …

One-pass AUC optimization

W Gao, R Jin, S Zhu, ZH Zhou - International conference on …, 2013 - proceedings.mlr.press
AUC is an important performance measure and many algorithms have been devoted to AUC
optimization, mostly by minimizing a surrogate convex loss on a training data set. In this …