Next Article in Journal
Inference of Genome-Scale Gene Regulatory Networks: Are There Differences in Biological and Clinical Validations?
Previous Article in Journal
Why Topology for Machine Learning and Knowledge Extraction?
Article Menu

Export Article

Open AccessArticle
Mach. Learn. Knowl. Extr. 2018, 1(1), 121-137; https://doi.org/10.3390/make1010007

Phi-Delta-Diagrams: Software Implementation of a Visual Tool for Assessing Classifier and Feature Performance

1
Department of Electrical and Electronic Engineering, University of Cagliari, 09124 Cagliari, Italy
2
Department of Mathematics & Computer Science, University of Marburg, 35037 Marburg, Germany
These authors contributed equally to this work.
*
Author to whom correspondence should be addressed.
Received: 15 May 2018 / Revised: 22 June 2018 / Accepted: 27 June 2018 / Published: 28 June 2018
(This article belongs to the Section Visualization)
Full-Text   |   PDF [909 KB, uploaded 20 July 2018]   |  

Abstract

In this article, a two-tiered 2D tool is described, called φ,δ diagrams, and this tool has been devised to support the assessment of classifiers in terms of accuracy and bias. In their standard versions, these diagrams provide information, as the underlying data were in fact balanced. Their generalization, i.e., ability to account for the imbalance, will be also briefly described. In either case, the isometrics of accuracy and bias are immediately evident therein, as—according to a specific design choice—they are in fact straight lines parallel to the x-axis and y-axis, respectively. φ,δ diagrams can also be used to assess the importance of features, as highly discriminant ones are immediately evident therein. In this paper, a comprehensive introduction on how to adopt φ,δ diagrams as a standard tool for classifier and feature assessment is given. In particular, with the goal of illustrating all relevant details from a pragmatic perspective, their implementation and usage as Python and R packages will be described. View Full-Text
Keywords: feature importance; classifier performance measures; confusion matrices; ROC curves; R-package; Python package feature importance; classifier performance measures; confusion matrices; ROC curves; R-package; Python package
Figures

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).
SciFeed

Share & Cite This Article

MDPI and ACS Style

Armano, G.; Giuliani, A.; Neumann, U.; Rothe, N.; Heider, D. Phi-Delta-Diagrams: Software Implementation of a Visual Tool for Assessing Classifier and Feature Performance. Mach. Learn. Knowl. Extr. 2018, 1, 121-137.

Show more citation formats Show less citations formats

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Mach. Learn. Knowl. Extr. EISSN 2504-4990 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top