GRRAS checklist for reporting of studies of reliability and agreement
Version based on Table I in: Kottner J, Audigé L, Brorson S, Donner A, Gajeweski BJ,
Hróbjartsson A, Robersts C, Shoukri M, Streiner DL. Guidelines for reporting reliability and
agreement studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64(1):96-106
Section          Item   Checklist item                                              Reported
                 #                                                                  on page #
Title/Abstract   1      Identify in title or abstract that interrater/intrarater
                        reliability or agreement was investigated.                          1
Introduction     2      Name and describe the diagnostic or measurement
                        device of interest explicitly.                                      2
                 3      Specify the subject population of interest.                    3
                 4      Specify the rater population of interest (if applicable).
                 5      Describe what is already known about reliability and
                        agreement and provide a rationale for the study (if             3
                        applicable).
Methods          6      Explain how the sample size was chosen. State the
                        determined number of raters, subjects/objects, and              3
                        replicate observations.
                 7      Describe the sampling method.                                   4
                 8      Describe the measurement/rating process (e.g. time
                        interval between repeated measurements, availability               4
                        of clinical information, blinding).
                 9      State whether measurements/ratings were conducted
                        independently.                                                  4
                 10     Describe the statistical analysis.                              5
Results          11     State the actual number of raters and subjects/objects
                        which were included and the number of replicate               4, 5
                        observations which were conducted.
                 12     Describe the sample characteristics of raters and
                        subjects (e.g. training, experience).                           3,4
                 13     Report estimates of reliability and agreement including
                        measures of statistical uncertainty.
                                                                                           5
Discussion       14     Discuss the practical relevance of results.                         6
Auxiliary        15     Provide detailed results if possible (e.g. online).
material