Next Article in Journal
Selenium and Selenoproteins in Immune Mediated Thyroid Disorders
Previous Article in Journal
Liquid Biopsy Potential Biomarkers in Prostate Cancer
Article Menu
Issue 4 (December) cover image

Export Article

Open AccessCommentary
Diagnostics 2018, 8(4), 69; https://doi.org/10.3390/diagnostics8040069

Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View

1
Department of Nuclear Medicine, Odense University Hospital, J.B. Winsløws Vej 4, 5000 Odense C, Denmark
2
Department of Clinical Research, University of Southern Denmark, Winsløwparken 19, 3. sal, 5000 Odense C, Denmark
3
Odense Patient data Explorative Network, Odense University Hospital, J.B. Winsløws Vej 9a, 5000 Odense C, Denmark
4
Department of Public Health, Epidemiology and Biostatistics, University of Southern Denmark, J.B. Winsløws Vej 9b, 5000 Odense C, Denmark
*
Author to whom correspondence should be addressed.
Received: 27 August 2018 / Revised: 17 September 2018 / Accepted: 18 September 2018 / Published: 24 September 2018
(This article belongs to the Section Medical Imaging)
Full-Text   |   PDF [205 KB, uploaded 24 September 2018]

Abstract

The Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed in 2011 to support transparent and accurate reporting. These studies may be conducted with the primary aim of estimating reliability and/or agreement itself, but are more often than not part of larger diagnostic accuracy studies, clinical trials, or epidemiological studies. As such, the study design may be compromised in terms of practicability issues, preventing the collection of sufficient results. We presented an example from a consultancy with a difficult mission and discussed five questions that concern the very nature of such a study (agreement vs. reliability; intra- vs. interrater), the rater population, explanatory factors in a multivariable model, and the statistical analysis strategy. Discussion of such basic methodological and statistical questions must take place before an investigation is started in order to ensure adequate data collection, to predict possible complications in the study, to plan sufficient statistical analyses, and to request timely assistance from an experienced statistician. GRRAS and its accompanying checklist of 15 items proved to be most helpful. Hopefully, our commentary will help improve the planning of agreement and reliability studies, which, in turn, will then be more focused, more appropriate, and more easily reported using GRRAS. View Full-Text
Keywords: agreement; guideline; interrater; intrarater; reliability; reproducibility agreement; guideline; interrater; intrarater; reliability; reproducibility
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).
SciFeed

Share & Cite This Article

MDPI and ACS Style

Gerke, O.; Möller, S.; Debrabant, B.; Halekoh, U.; Odense Agreement Working Group. Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View. Diagnostics 2018, 8, 69.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Diagnostics EISSN 2075-4418 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top