Exploring Inter-rater Agreement in Scoring of the Revised Token Test

Odekar, Anshula and Hallowell, Brooke (2005) Exploring Inter-rater Agreement in Scoring of the Revised Token Test. [Clinical Aphasiology Paper]

PDF d3d378c92fce186a33e99a035d28.pdf Download (35kB)

Abstract

Reliable and accurate scoring is an especially challenging issue for tests using multidimensional scoring. In this exploratory study, we examined patterns of inter-rater disagreements in RTT scoring. Scoring reports of two raters for each of 10 adults with aphasia and 30 language-normal adults were analyzed. Results reveal that subtest characteristics, variety of error types, and context of scoring are important factors to emphasize during training to minimize scoring errors and thus increase reliability. Implications are extensive; Reliable identification of subtle deficiencies in patient responses is essential not only for RTT administration but also for developing effective clinical observation skills.

Actions (login required)

View Item