Discovering the preferences of physicians with regards to rank-ordered medical documents


The practice of evidence-based medicine involves consulting documents from repositories such as Scopus, PubMed, or the Cochrane Library. The most common approach for presenting retrieved documents is in the form of a list, with the assumption that the higher a document is on a list, the more relevant it is. Despite this list-based presentation, it is seldom studied how physicians perceive the importance of the order of documents presented in a list. This paper describes an empirical study that elicited and modeled physicians' preferences with regard to list-based results. Preferences were analyzed using a GRIP method that relies on pairwise comparisons of selected subsets of possible rank-ordered lists composed of 3 documents. The results allow us to draw conclusions regarding physicians' attitudes towards the importance of having documents ranked correctly on a result list, versus the importance of retrieving relevant but misplaced documents. Our findings should help developers of clinical information retrieval applications when deciding how retrieved documents should be presented and how performance of the application should be assessed.

Publication DOI:
Divisions: Engineering & Applied Sciences > Computer Science
Event Title: 14th international conference on Information Processing and Management of Uncertainty in knowledge-based systems
Event Type: Other
Event Dates: 2012-07-09 - 2012-07-13
Uncontrolled Keywords: Document Retrieval,Evidence-Based Medicine,Information Retrieval,Physician preferences,Rank-ordered Lists,Computer Science(all)
ISBN: 978-3-642-31717-0, 978-3-642-31718-7
Full Text Link: ... r_ipmu_2012.pdf
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Conference contribution
Published Date: 2012
Authors: O'Sullivan, Dympna
Wilk, Szymon
Michalowski, Wojtek
Słowiński, Roman
Thomas, Roland
Farion, Ken

Export / Share Citation


Additional statistics for this record