Towards enhanced second language reading comprehension assessment: Computerized versus manual scoring of written recall protocols

Repository record updated on:

Nov. 11, 2020, 1:01 p.m.

Database record updated on:

Nov. 14, 2020, 1:23 a.m.

Last Harvested on:

Nov. 14, 2020, 1:23 a.m.

bitstream:

http://scholarspace.manoa.hawaii.edu/bitstream/10125/66779/1/16_2_10125_66779_heinz.pdf

bitstream_txt:

http://scholarspace.manoa.hawaii.edu/bitstream/10125/66779/2/16_2_10125_66779_heinz.pdf.txt

collection:

Volume 16, No. 2

contributor.author:

Heinz, Peter J.

date.accessioned:

2020-05-22T02:00:00Z

date.available:

2020-05-22T02:00:00Z

date.issued:

2004-10

description.abstract:

Second language (L2) reading comprehension assessment has long relied upon classical quantitative, product-oriented measurement techniques (i.e., multiple-choice and cloze) in both research and classroom assessment. As Bernhardt (1991) clearly demonstrated, these traditionally employed assessment methods are unable to capture the complex processes that take place between learner and text. The present paper has as its central purpose to enhance and extend the efficiency, consistency, and validity of an alternative measure, the immediate free recall protocol. Unlike the multiple choice or cloze tests, the recall protocol is a truly integrative authentic-task measure, firmly grounded on a constructivist model of reading comprehension. Given an understanding of the model, the literature base on memorial representation, and the formulation of a "weak-rule" scoring system, the present study demonstrates a computerized recall protocol scoring system that has high correlation with traditional manual scoring methods. The results further demonstrate that the computerized procedure provides efficiency in delivery and scoring, enhances consistency, is practical for large-scale assessment, and can lead to improved diagnostic and placement testing. Using this system as part of a multiple-measures approach, valid and reliable quantitative score information is readily available and directly linked to a qualitative database ripe for additional examination to advance L2 reading comprehension research and model development.

description.provenance:

Made available in DSpace on 2020-05-22T02:00:00Z (GMT). No. of bitstreams: 1 16_2_10125_66779_heinz.pdf: 86226 bytes, checksum: bee3d0d76df5b3a699cd96d7bc5b2738 (MD5) Previous issue date: 2004-10

endingpage:

124

identifier.doi:

10125/66779

identifier.issn:

1539-0578

identifier.uri:

http://hdl.handle.net/10125/66779

number:

2

publisher:

University of Hawaii National Foreign Language Resource Center Center for Language & Technology

rfl.topic:

Research Methods

site_url:

/rfl/item/90

startingpage:

97

subject:

reading comprehension assessment recall protocol computer based testing

title:

Towards enhanced second language reading comprehension assessment: Computerized versus manual scoring of written recall protocols

type:

Article

type.dcmi:

Text

volume:

16