Next Article in Journal
Hash-Based Hierarchical Caching and Layered Filtering for Interactive Previews in Global Illumination Rendering
Next Article in Special Issue
To Adapt or Not to Adapt: A Quantification Technique for Measuring an Expected Degree of Self-Adaptation
Previous Article in Journal
Design, Fabrication, and Testing of an IoT Healthcare Cardiac Monitoring Device
Previous Article in Special Issue
On Implementing Autonomic Systems with a Serverless Computing Approach: The Case of Self-Partitioning Cloud Caches
Open AccessArticle

Evaluation of Self-Healing Systems: An Analysis of the State-of-the-Art and Required Improvements

Hasso Plattner Institute, University of Potsdam, Prof.-Dr.-Helmert-Str. 2-3, D-14482 Potsdam, Germany
*
Author to whom correspondence should be addressed.
Computers 2020, 9(1), 16; https://doi.org/10.3390/computers9010016
Received: 12 January 2020 / Revised: 13 February 2020 / Accepted: 14 February 2020 / Published: 27 February 2020
(This article belongs to the Special Issue Applications in Self-Aware Computing Systems and their Evaluation)
Evaluating the performance of self-adaptive systems is challenging due to their interactions with often highly dynamic environments. In the specific case of self-healing systems, the performance evaluations of self-healing approaches and their parameter tuning rely on the considered characteristics of failure occurrences and the resulting interactions with the self-healing actions. In this paper, we first study the state-of-the-art for evaluating the performances of self-healing systems by means of a systematic literature review. We provide a classification of different input types for such systems and analyse the limitations of each input type. A main finding is that the employed inputs are often not sophisticated regarding the considered characteristics for failure occurrences. To further study the impact of the identified limitations, we present experiments demonstrating that wrong assumptions regarding the characteristics of the failure occurrences can result in large performance prediction errors, disadvantageous design-time decisions concerning the selection of alternative self-healing approaches, and disadvantageous deployment-time decisions concerning parameter tuning. Furthermore, the experiments indicate that employing multiple alternative input characteristics can help with reducing the risk of premature disadvantageous design-time decisions. View Full-Text
Keywords: self-healing; failure model; performance; simulation; evaluation self-healing; failure model; performance; simulation; evaluation
Show Figures

Figure 1

MDPI and ACS Style

Ghahremani, S.; Giese, H. Evaluation of Self-Healing Systems: An Analysis of the State-of-the-Art and Required Improvements. Computers 2020, 9, 16.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop