The mosaic test:measuring the effectiveness of colour-based image retrieval


A variety of content-based image retrieval systems exist which enable users to perform image retrieval based on colour content - i.e., colour-based image retrieval. For the production of media for use in television and film, colour-based image retrieval is useful for retrieving specifically coloured animations, graphics or videos from large databases (by comparing user queries to the colour content of extracted key frames). It is also useful to graphic artists creating realistic computer-generated imagery (CGI). Unfortunately, current methods for evaluating colour-based image retrieval systems have 2 major drawbacks. Firstly, the relevance of images retrieved during the task cannot be measured reliably. Secondly, existing methods do not account for the creative design activity known as reflection-in-action. Consequently, the development and application of novel and potentially more effective colour-based image retrieval approaches, better supporting the large number of users creating media for use in television and film productions, is not possible as their efficacy cannot be reliably measured and compared to existing technologies. As a solution to the problem, this paper introduces the Mosaic Test. The Mosaic Test is a user-based evaluation approach in which participants complete an image mosaic of a predetermined target image, using the colour-based image retrieval system that is being evaluated. In this paper, we introduce the Mosaic Test and report on a user evaluation. The findings of the study reveal that the Mosaic Test overcomes the 2 major drawbacks associated with existing evaluation methods and does not require expert participants.

Publication DOI:
Divisions: ?? 50811700Jl ??
College of Engineering & Physical Sciences > Systems analytics research institute (SARI)
Additional Information: The original publication is available at
Uncontrolled Keywords: content-based image retrieval,image databases,Iimage retrieval,performance evaluation,query-by-colour,query-by-sketch,Media Technology,Hardware and Architecture,Computer Networks and Communications,Software
Publication ISSN: 1573-7721
Last Modified: 20 Mar 2024 08:10
Date Deposited: 18 Sep 2013 10:18
Full Text Link: http://www.spri ... 557u1371641763/
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Article
Published Date: 2013-06
Published Online Date: 2012-01-04
Authors: Plant, William
Lumsden, Jo (ORCID Profile 0000-0002-8637-7647)
Nabney, Ian (ORCID Profile 0000-0003-1513-993X)



Version: Accepted Version

Export / Share Citation


Additional statistics for this record