Bi-Gaussianized calibration of likelihood ratios

Abstract

For a perfectly calibrated forensic evaluation system, the likelihood ratio of the likelihood ratio is the likelihood ratio. Conversion of uncalibrated log-likelihood ratios (scores) to calibrated log-likelihood ratios is often performed using logistic regression. The results, however, may be far from perfectly calibrated. We propose and demonstrate a new calibration method, “bi-Gaussianized calibration,” that warps scores toward perfectly calibrated log-likelihood-ratio distributions. Using both synthetic and real data, we demonstrate that bi-Gaussianized calibration leads to better calibration than does logistic regression, that it is robust to score distributions that violate the assumption of two Gaussians with the same variance, and that it is competitive with logistic-regression calibration in terms of performance measured using log-likelihood-ratio cost (Cllr). We also demonstrate advantages of bi-Gaussianized calibration over calibration using pool-adjacent violators (PAV). Based on bi-Gaussianized calibration, we also propose a graphical representation that may help explain the meaning of likelihood ratios to triers of fact.

Publication DOI: https://doi.org/10.1093/lpr/mgae004
Divisions: College of Business and Social Sciences > Aston Institute for Forensic Linguistics
College of Engineering & Physical Sciences
Aston University (General)
Funding Information: This work was supported by Research England’s Expanding Excellence in England Fund as part of funding for the Aston Institute for Forensic Linguistics 2019–2024.
Additional Information: Publisher Copyright: # The Authors (2024).
Uncontrolled Keywords: Gaussian distribution,calibration,likelihood ratio,logistic regression,Philosophy,Law,Statistics, Probability and Uncertainty
Publication ISSN: 1470-840X
Last Modified: 02 Dec 2024 09:05
Date Deposited: 15 Apr 2024 13:45
Full Text Link:
Related URLs: https://academi ... 346?login=false (Publisher URL)
http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Article
Published Date: 2024-04-11
Accepted Date: 2024-03-10
Authors: Morrison, Geoffrey Stewart (ORCID Profile 0000-0001-8608-8207)

Download

[img]

Version: Published Version

License: Creative Commons Attribution

| Preview

Export / Share Citation


Statistics

Additional statistics for this record