4 Attribute Agreement Analysis Method

Module 6 Attribute Systems Assessment

Lesson M6-04

Text: Section 5

Duration: 23 minutes

Attribute Agreement Analysis Method

Lesson 4 introduces the Attribute Agreement Analysis method which may be used to assess binary, ordinal, or nominal responses.  We define some descriptive statistics that assess performance: % Agreement, Kappa, Kendall’s Coefficient of Concordance.  These statistics may be used to assess within appraiser agreement, between appraiser agreement, and agreement with known values.  The hypothesis tests associated with Kappa statistics are reviewed. The key steps and guidelines for conducting an Attribute Agreement Analysis study are presented.  Finally, acceptance criteria are discussed.