A psychophysical performance-based approach to the quality assessment of image processing algorithms


Image processing algorithms are used to improve digital image representations in either their appearance or storage efficiency. The merit of these algorithms depends, in part, on visual perception by human observers. However, in practice, most are assessed numerically, and the perceptual metrics that do exist are criterion sensitive with several shortcomings. Here we propose an objective performance-based perceptual measure of image quality and demonstrate this by comparing the efficacy of a denoising algorithm for a variety of filters. For baseline, we measured detection thresholds for a white noise signal added to one of a pair of natural images in a two-alternative forced-choice (2AFC) paradigm where each image was selected randomly from a set of n = 308 on each trial. In a series of experimental conditions, the stimulus image pairs were passed through various configurations of a denoising algorithm. The differences in noise detection thresholds with and without denoising are objective perceptual measures of the ability of the algorithm to render noise invisible. This was a factor of two (6dB) in our experiment and consistent across a range of filter bandwidths and types. We also found that thresholds in all conditions converged on a common value of PSNR, offering support for this metric. We discuss how the 2AFC approach might be used for other algorithms including compression, deblurring and edge-detection. Finally, we provide a derivation for our Cartesian-separable log-Gabor filters, with polar parameters. For the biological vision community this has some advantages over the more typical (i) polar-separable variety and (ii) Cartesian-separable variety with Cartesian parameters.

Publication DOI: https://doi.org/10.1371/journal.pone.0267056
Divisions: College of Health & Life Sciences > School of Optometry > Optometry
College of Health & Life Sciences > School of Optometry > Optometry & Vision Science Research Group (OVSRG)
College of Health & Life Sciences > Clinical and Systems Neuroscience
College of Health & Life Sciences > School of Optometry > Vision, Hearing and Language
College of Health & Life Sciences > School of Optometry > Centre for Vision and Hearing Research
College of Health & Life Sciences
Additional Information: © 2022 Baker et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Funding: Supported by the Engineering and Physical Sciences Research Council (https://epsrc.ukri.org/), Grant EP/H000038/1 awarded to TSM. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Uncontrolled Keywords: Algorithms,Data Compression,Humans,Image Processing, Computer-Assisted/methods,Noise,Signal-To-Noise Ratio
Publication ISSN: 1932-6203
Last Modified: 06 May 2024 07:37
Date Deposited: 06 May 2022 08:50
Full Text Link:
Related URLs: https://journal ... al.pone.0267056 (Publisher URL)
http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Article
Published Date: 2022-05-05
Accepted Date: 2022-03-31
Submitted Date: 2021-11-17
Authors: Baker, Daniel H.
Summers, Robert J.
Baldwin, Alex S.
Meese, Tim S. (ORCID Profile 0000-0003-3744-4679)



Version: Published Version

License: Creative Commons Attribution

| Preview

Export / Share Citation


Additional statistics for this record