Automatic summary assessment for intelligent tutoring systems

He, Yulan, Hui, Siu C. and Quan, Tho T. (2009). Automatic summary assessment for intelligent tutoring systems. Computers and Education, 53 (3), pp. 890-899.

Abstract

Summary writing is an important part of many English Language Examinations. As grading students' summary writings is a very time-consuming task, computer-assisted assessment will help teachers carry out the grading more effectively. Several techniques such as latent semantic analysis (LSA), n-gram co-occurrence and BLEU have been proposed to support automatic evaluation of summaries. However, their performance is not satisfactory for assessing summary writings. To improve the performance, this paper proposes an ensemble approach that integrates LSA and n-gram co-occurrence. As a result, the proposed ensemble approach is able to achieve high accuracy and improve the performance quite substantially compared with current techniques. A summary assessment system based on the proposed approach has also been developed.

Publication DOI: https://doi.org/10.1016/j.compedu.2009.05.008
Divisions: Engineering & Applied Sciences > Computer science
Engineering & Applied Sciences > Systems analytics research institute (SARI)
Engineering & Applied Sciences > Computer science research group
Additional Information: NOTICE: this is the author’s version of a work that was accepted for publication in Computers and education. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in He, Y, Hui, SC & Quan, TT, 'Automatic summary assessment for intelligent tutoring systems' Computers and education, vol. 53, no. 3 (2009) DOI http://dx.doi.org/10.1016/j.compedu.2009.05.008.
Uncontrolled Keywords: summary writing assessment,intelligent tutoring systems,latent semantic analysis,N-gram co-occurrence,adaptive feedback
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
Published Date: 2009-11
Authors: He, Yulan ( 0000-0003-3948-5845)
Hui, Siu C.
Quan, Tho T.

Download

[img]

Version: Accepted Version


Export / Share Citation


Statistics

Additional statistics for this record