Oliveira Ribeiro, Rafael, Neves, João, Ruifrok, Arnout and Vidal, Flavio de Barros (2024). Improving the evidential value of low-quality face images with aggregation of deep neural network embeddings. Science and Justice, 64 (5), pp. 509-520.
Abstract
In forensic facial comparison, questioned-source images are usually captured in uncontrolled environments, with non-uniform lighting, and from non-cooperative subjects. The poor quality of such material usually compromises their value as evidence in legal proceedings. On the other hand, in forensic casework, multiple images of the person of interest are usually available. In this paper, we propose to aggregate deep neural network embeddings from various images of the same person to improve the performance in forensic comparison of facial images. We observe significant performance improvements, especially for low-quality images. Further improvements are obtained by aggregating embeddings of more images and by applying quality-weighted aggregation. We demonstrate the benefits of this approach in forensic evaluation settings with the development and validation of common-source likelihood ratio systems and report improvements in both for CCTV images and for social media images.
Publication DOI: | https://doi.org/10.1016/j.scijus.2024.07.006 |
---|---|
Divisions: | College of Business and Social Sciences > Aston Institute for Forensic Linguistics |
Funding Information: | Funding source: This research was partially supported by NOVA LINCS (UIDB/04516/2020) with the financial support of FCT.IP |
Additional Information: | Copyright © 2024 The Authors. Published by Elsevier B.V. on behalf of The Chartered Society of Forensic Sciences. This is an open access article under the CC BY license (https://creativecommons.org/licenses/by/4.0/). |
Uncontrolled Keywords: | Forensic evaluation,Face comparisons,Embedding aggregation,Likelihood ratio |
Publication ISSN: | 1355-0306 |
Data Access Statement: | Supplementary data to this article can be found online at https://doi.org/10.1016/j.scijus.2024.07.006 |
Last Modified: | 13 Aug 2024 07:06 |
Date Deposited: | 12 Aug 2024 14:53 |
Full Text Link: | |
Related URLs: |
https://www.sci ... 35503062400073X
(Publisher URL) |
PURE Output Type: | Article |
Published Date: | 2024-09 |
Published Online Date: | 2024-08-07 |
Accepted Date: | 2024-07-29 |
Authors: |
Oliveira Ribeiro, Rafael
(![]() Neves, João Ruifrok, Arnout Vidal, Flavio de Barros |