ISPRS Int. J. Geo-Inf. 2013, 2(3), 869-887; doi:10.3390/ijgi2030869

A Suite of Tools for ROC Analysis of Spatial Models

1,* email, 2email, 3email, 1email and 2email
Received: 25 July 2013; in revised form: 13 August 2013 / Accepted: 29 August 2013 / Published: 10 September 2013
View Full-Text   |   Download PDF [637 KB, updated 11 September 2013; original version uploaded 10 September 2013]
Abstract: The Receiver Operating Characteristic (ROC) is widely used for assessing the performance of classification algorithms. In GIScience, ROC has been applied to assess models aimed at predicting events, such as land use/cover change (LUCC), species distribution and disease risk. However, GIS software packages offer few statistical tests and guidance tools for ROC analysis and interpretation. This paper presents a suite of GIS tools designed to facilitate ROC curve analysis for GIS users by applying proper statistical tests and analysis procedures. The tools are freely available as models and submodels of Dinamica EGO freeware. The tools give the ROC curve, the area under the curve (AUC), partial AUC, lower and upper AUCs, the confidence interval of AUC, the density of event in probability bins and tests to evaluate the difference between the AUCs of two models. We present first the procedures and statistical tests implemented in Dinamica EGO, then the application of the tools to assess LUCC and species distribution models. Finally, we interpret and discuss the ROC-related statistics resulting from various case studies.
Keywords: accuracy; AUC; Dinamica EGO; LUCC; prediction; ROC; species distribution modeling; uncertainty; validation
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Export to BibTeX |

MDPI and ACS Style

Mas, J.-F.; Soares Filho, B.; Pontius, R.G.; Farfán Gutiérrez, M.; Rodrigues, H. A Suite of Tools for ROC Analysis of Spatial Models. ISPRS Int. J. Geo-Inf. 2013, 2, 869-887.

AMA Style

Mas J-F, Soares Filho B, Pontius RG, Farfán Gutiérrez M, Rodrigues H. A Suite of Tools for ROC Analysis of Spatial Models. ISPRS International Journal of Geo-Information. 2013; 2(3):869-887.

Chicago/Turabian Style

Mas, Jean-François; Soares Filho, Britaldo; Pontius, Robert G.; Farfán Gutiérrez, Michelle; Rodrigues, Hermann. 2013. "A Suite of Tools for ROC Analysis of Spatial Models." ISPRS Int. J. Geo-Inf. 2, no. 3: 869-887.

ISPRS Int. J. Geo-Inf. EISSN 2220-9964 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert