… is a fair performance metric? We consider the choice of fairness metrics through the lens of
metric elicitation – a principled framework for selecting performance metrics that best reflect …

… We show its application in eliciting quadratic violation-based group-fair metrics. Our strategy
… strategy to eliciting polynomial metrics – thus broadening the use cases for metric elicitation. …

… Specifically, we provide novel strategies for eliciting linear and linear-fractional metrics for …
group-fair performance metrics in the presence of multiple sensitive groups. All the elicitation …

… of Metric Elicitation. The goal of metric elicitation is to discover the performance metric of a
… In particular, we focus on eliciting binary classification performance metrics from pairwise …

… Analogous to Definition 1–2, we present the problem of fair quadratic metric elicitation. …
We present an elicitation strategy for the fair quadratic metric in Definition 4 by adapting the …

… according to the metric. Compared to our work, they assume the existence of a fairness
metric which can be accessed using a quantitative oracle, and they use this metric to define a …

… We build an interactive AI for skill elicitation that provides … Elicitation mitigates endogenous
bias arising from individuals’ … Our end goal is to create a fair scoring function (fϕ(xi)) that …

… preference elicitation or performance metric elicitation. Use cases of moral preference
elicitation… Fair performance metric elicitation. arXiv preprint arXiv:2006.12732 (2020). [37] Kenneth …

… The true performance metric ϕ for metric elicitation is estimated by querying an oracle Ω with
pairwise comparisons of the confusion matrices of different classifiers, which is represented …

… In this work, we seek to elicit a linear performance metric, which for some weights a is defined
… Since the metrics are scale invariant [9], we assume a1 = 1. Hence, the linear metrics can …