The Aphasiology Archive
University Library System, University of Pittsburgh

The inter-rater reliability of the story retell procedure

Hula, William D. and McNeil, Malcolm R. and Doyle, Patrick J. and Rubinsky, Hillel J. and Fossett, Tepanta R.D.
The inter-rater reliability of the story retell procedure. Aphasiology, 17(5), 2003, pages 523-528.


Background: McNeil, Doyle, Fossett, Park, and Goda (2001) have presented the story retell procedure (SRP) as an efficient means of assessing discourse in adults with aphasia, in part because it provides reliable, valid, and sensitive indices of performance without the need for time-consuming transcription of language samples. Aims: The purpose of this study was to demonstrate that the SRP, when scored without transcription by judges with minimal training, produces a reliable measure of information transfer. Methods & Procedures: Four judges who had not used the SRP previously scored audio-recorded language samples, produced by four subjects with aphasia and eleven normal subjects, for percent information units per minute (%IU/Min). Outcomes & Results: The results demonstrate that the SRP has high inter-rater reliability. Reliability coefficients ranged from .89 to .995, and the standard error of measurement associated with inter-rater scoring error ranged from .59 to 1.42 %IU/Min. Point-to-point reliability in scoring individual information units ranged from 85-95% and averaged 91% for both subject groups. Conclusions: The SRP is a potentially useful tool for quantifying connected language behaviour, and may be particularly valuable in clinical and research settings where economy of assessment procedures is essential.

EPrint Type:Journal (Paginated)
ID Code:1214
Conference:Clinical Aphasiology Conference: Clinical Aphasiology Conference (2002 : 32nd : Ridgedale, MO : June 2002)
Conference Date:June 2002
Publisher:Taylor & Francis
Publication Location:London
Alternative Locations:,
Additional Information:Access to Full Text is subject to the Publisher's access restrictions