Automatic summary assessment for intelligent tutoring systems

Abstract

Summary writing is an important part of many English Language Examinations. As grading students' summary writings is a very time-consuming task, computer-assisted assessment will help teachers carry out the grading more effectively. Several techniques such as latent semantic analysis (LSA), n-gram co-occurrence and BLEU have been proposed to support automatic evaluation of summaries. However, their performance is not satisfactory for assessing summary writings. To improve the performance, this paper proposes an ensemble approach that integrates LSA and n-gram co-occurrence. As a result, the proposed ensemble approach is able to achieve high accuracy and improve the performance quite substantially compared with current techniques. A summary assessment system based on the proposed approach has also been developed.

Publication DOI: https://doi.org/10.1016/j.compedu.2009.05.008
Divisions: College of Engineering & Physical Sciences > Systems analytics research institute (SARI)
?? 50811700Jl ??
Additional Information: NOTICE: this is the author’s version of a work that was accepted for publication in Computers and education. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in He, Y, Hui, SC & Quan, TT, 'Automatic summary assessment for intelligent tutoring systems' Computers and education, vol. 53, no. 3 (2009) DOI http://dx.doi.org/10.1016/j.compedu.2009.05.008.
Uncontrolled Keywords: summary writing assessment,intelligent tutoring systems,latent semantic analysis,N-gram co-occurrence,adaptive feedback
Publication ISSN: 1873-782X
Last Modified: 19 Mar 2024 08:10
Date Deposited: 24 Jan 2013 13:35
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Article
Published Date: 2009-11
Authors: He, Yulan (ORCID Profile 0000-0003-3948-5845)
Hui, Siu C.
Quan, Tho T.

Download

[img]

Version: Accepted Version


Export / Share Citation


Statistics

Additional statistics for this record