Next Article in Journal
The Spatial and Temporal Evolution of the Coordination Degree in Regard to Farmland Transfer and Cultivated Land Green Utilization Efficiency in China
Next Article in Special Issue
Forecasting HFMD Cases Using Weather Variables and Google Search Queries in Sabah, Malaysia
Previous Article in Journal
Multi-Sector Assessment and Client-Perception of Social Need at Long-Term Follow-Up of a Group-Randomized Trial of Community-Engaged Collaborative Care for Adults with Depression
Previous Article in Special Issue
Predicting Type 2 Diabetes Using Logistic Regression and Machine Learning Approaches
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 19
Issue 16
10.3390/ijerph191610213
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Cohen’s Kappa Coefficient as a Measure to Assess Classification Improvement following the Addition of a New Marker to a Regression Model

by
Barbara Więckowska
1,*,
Katarzyna B. Kubiak
1,
Paulina Jóźwiak
2,
Wacław Moryson
3 and
Barbara Stawińska-Witoszyńska
3
1
Department of Computer Science and Statistics, Poznan University of Medical Sciences, 60-806 Poznan, Poland
2
Department of Preventive Medicine, Poznan University of Medical Sciences, 60-781 Poznan, Poland
3
Department of Epidemiology and Hygiene, Chair of Social Medicine, Poznan University of Medical Sciences, 60-806 Poznan, Poland
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(16), 10213; https://doi.org/10.3390/ijerph191610213
Submission received: 26 July 2022 / Revised: 13 August 2022 / Accepted: 15 August 2022 / Published: 17 August 2022
(This article belongs to the Special Issue Statistical Methods with Applications in Human Health and Disease)
Browse Figure
Review Reports Versions Notes

Abstract

The need to search for new measures describing the classification of a logistic regression model stems from the difficulty in searching for previously unknown factors that predict the occurrence of a disease. A classification quality assessment can be performed by testing the change in the area under the receiver operating characteristic curve (AUC). Another approach is to use the Net Reclassification Improvement (NRI), which is based on a comparison between the predicted risk, determined on the basis of the basic model, and the predicted risk that comes from the model enriched with an additional factor. In this paper, we draw attention to Cohen’s Kappa coefficient, which examines the actual agreement in the correction of a random agreement. We proposed to extend this coefficient so that it may be used to detect the quality of a logistic regression model reclassification. The results provided by Kappa‘s reclassification were compared with the results obtained using NRI. The random variables’ distribution attached to the model on the classification change, measured by NRI, Kappa, and AUC, was presented. A simulation study was conducted on the basis of a cohort containing 3971 Poles obtained during the implementation of a lower limb atherosclerosis prevention program.
Keywords: Cohen’s Kappa coefficient; NRI net reclassification ratio; logistic regression model; reclassification; AUC Cohen’s Kappa coefficient; NRI net reclassification ratio; logistic regression model; reclassification; AUC

Share and Cite

MDPI and ACS Style

Więckowska, B.; Kubiak, K.B.; Jóźwiak, P.; Moryson, W.; Stawińska-Witoszyńska, B. Cohen’s Kappa Coefficient as a Measure to Assess Classification Improvement following the Addition of a New Marker to a Regression Model. Int. J. Environ. Res. Public Health 2022, 19, 10213. https://doi.org/10.3390/ijerph191610213

AMA Style

Więckowska B, Kubiak KB, Jóźwiak P, Moryson W, Stawińska-Witoszyńska B. Cohen’s Kappa Coefficient as a Measure to Assess Classification Improvement following the Addition of a New Marker to a Regression Model. International Journal of Environmental Research and Public Health. 2022; 19(16):10213. https://doi.org/10.3390/ijerph191610213

Chicago/Turabian Style

Więckowska, Barbara, Katarzyna B. Kubiak, Paulina Jóźwiak, Wacław Moryson, and Barbara Stawińska-Witoszyńska. 2022. "Cohen’s Kappa Coefficient as a Measure to Assess Classification Improvement following the Addition of a New Marker to a Regression Model" International Journal of Environmental Research and Public Health 19, no. 16: 10213. https://doi.org/10.3390/ijerph191610213

APA Style

Więckowska, B., Kubiak, K. B., Jóźwiak, P., Moryson, W., & Stawińska-Witoszyńska, B. (2022). Cohen’s Kappa Coefficient as a Measure to Assess Classification Improvement following the Addition of a New Marker to a Regression Model. International Journal of Environmental Research and Public Health, 19(16), 10213. https://doi.org/10.3390/ijerph191610213

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop