The role of verbal and pictorial information in multimodal incidental acquisition of foreign language vocabulary


This study used eye tracking to investigate the allocation of attention to multimodal stimuli during an incidental learning situation, as well as its impact on subsequent explicit learning. Participants were exposed to foreign language (FL) auditory words on their own, in conjunction with written native language (NL) translations, or with both written NL translations and pictures. Incidental acquisition of FL words was assessed the following day through an explicit learning task where participants learned to recognize translation equivalents, as well as one week later through recall and translation recognition tests. Results showed higher accuracy scores in the explicit learning task for FL words presented with meaning during incidental learning, whether written meaning or both written meaning and picture, than for FL words presented auditorily only. However, participants recalled significantly more FL words after a week delay if they had been presented with a picture during incidental learning. In addition, the time spent looking at the pictures during incidental learning significantly predicted recognition and recall scores one week later. Overall, results demonstrated the impact of exposure to multimodal stimuli on subsequent explicit learning, as well as the important role that pictorial information can play in incidental vocabulary acquisition.

Publication DOI:
Divisions: College of Health & Life Sciences
Additional Information: © 2014 The Author. Published by Taylor & Francis This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons. org/licenses/by/3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The moral rights of the named author(s) have been asserted.
Uncontrolled Keywords: Eye tracking,Foreign language learning,Incidental learning,Multimodalities,Vocabulary acquisition,Physiology,Neuropsychology and Physiological Psychology,Experimental and Cognitive Psychology,Psychology(all),Physiology (medical)
Publication ISSN: 1747-0226
Last Modified: 17 Jun 2024 07:35
Date Deposited: 15 Oct 2018 10:23
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
http://journals ... 218.2014.979211 (Publisher URL)
PURE Output Type: Article
Published Date: 2015-07-01
Authors: Bisson, Marie Josée
van Heuven, Walter J.B.
Conklin, Kathy
Tunney, Richard J. (ORCID Profile 0000-0003-4673-757X)



Version: Published Version

License: Creative Commons Attribution

| Preview

Export / Share Citation


Additional statistics for this record