Skip to Content

18,990 Results Found

  • Review
  • Open Access
  • Best Paper Award
601 Citations
43,522 Views
19 Pages

Evaluating the Quality of Machine Learning Explanations: A Survey on Methods and Metrics

  • Jianlong Zhou,
  • Amir H. Gandomi,
  • Fang Chen and
  • Andreas Holzinger

The most successful Machine Learning (ML) systems remain complex black boxes to end-users, and even experts are often unable to understand the rationale behind their decisions. The lack of transparency of such systems can have severe consequences or...

(This article belongs to the Special Issue Machine Learning Technologies for Big Data Analytics)
  • Article
  • Open Access
16 Citations
6,443 Views
20 Pages

Evaluating Research Centers in Minority Institutions: Framework, Metrics, Best Practices, and Challenges

  • Angela Sy,
  • Traci Hayes,
  • Kelly Laurila,
  • Carlamarie Noboa and ,
  • Robbert J. Langwerden,
  • Michelle M. Hospital,
  • Doris A. Andújar-Pérez,
  • Lakesha Stevenson,
  • Suzanne M. Randolph Cunningham and
  • Shiva Mehravaran
  • + 8 authors+ 3 authors

The NIH-funded Research Centers in Minority Institutions (RCMI) program is currently funding 18 academic institutions to strengthen the research environment and contribution to health disparities research. The purpose of this multiphase mixed-methods...

(This article belongs to the Special Issue Proceedings of the 2019 Research Centers in Minority Institutions (RCMI) Program National Conference)
  • Article
  • Open Access
22 Citations
5,715 Views
27 Pages

Comprehensive and Dedicated Metrics for Evaluating AI-Generated Residential Floor Plans

  • Pengyu Zeng,
  • Jun Yin,
  • Yan Gao,
  • Jizhizi Li and ,
  • Zhanxiang Jin and
  • Shuai Lu
  • + 1 author+ 0 author

In response to the growing importance of AI-driven residential design and the lack of dedicated evaluation metrics, we propose the Residential Floor Plan Assessment (RFP-A), a comprehensive framework tailored to architectural evaluation. RFP-A consis...

(This article belongs to the Special Issue Urban Planning and Construction Management Under Smart City Development)
  • Review
  • Open Access
2 Citations
851 Views
35 Pages

Artificial intelligence-driven molecular generation has become an increasingly used computational approach for proposing candidate chemical structures in early-stage drug discovery, yet the practical value of the molecules produced is often difficult...

(This article belongs to the Special Issue Machine Learning Approaches in Drug Molecule Design)
  • Article
  • Open Access
4 Citations
5,196 Views
14 Pages

5 January 2021

Recently, 360° content has emerged as a new method for offering real-life interaction. Ultra-high resolution 360° content is mapped to the two-dimensional plane to adjust to the input of existing generic coding standards for transmission. Man...

(This article belongs to the Special Issue Symmetry and Asymmetry in Communications Engineering)
  • Article
  • Open Access
7 Citations
6,728 Views
45 Pages

PEARL: A Rubric-Driven Multi-Metric Framework for LLM Evaluation

  • Catalin Anghel,
  • Andreea Alexandra Anghel,
  • Emilia Pecheanu,
  • Marian Viorel Craciun and ,
  • Adina Cocu and
  • Cristian Niculita
  • + 1 author+ 0 author

22 October 2025

Background and objectives: Evaluating Large Language Models (LLMs) presents two interrelated challenges: the general problem of assessing model performance across diverse tasks and the specific problem of using LLMs themselves as evaluators in pedago...

  • Article
  • Open Access
2 Citations
2,702 Views
24 Pages

Effectively Combining Risk Evaluation Metrics for Precise Fault Localization

  • Adekunle Ajibode,
  • Ting Shu,
  • Laghari Gulsher and
  • Zuohua Ding

22 October 2022

Spectrum-based fault localization (SBFL) is an automated fault localization technique that uses risk evaluation metrics to compute the suspiciousness scores from program spectra. Thus, risk evaluation metrics determine the technique’s performan...

(This article belongs to the Section E1: Mathematics and Computer Science)
  • Article
  • Open Access
122 Citations
36,225 Views
22 Pages

A Survey on Evaluation Metrics for Machine Translation

  • Seungjun Lee,
  • Jungseob Lee,
  • Hyeonseok Moon,
  • Chanjun Park and ,
  • Jaehyung Seo,
  • Sugyeong Eo,
  • Seonmin Koo and
  • Heuiseok Lim
  • + 3 authors+ 0 author

16 February 2023

The success of Transformer architecture has seen increased interest in machine translation (MT). The translation quality of neural network-based MT transcends that of translations derived using statistical methods. This growth in MT research has enta...

(This article belongs to the Section E1: Mathematics and Computer Science)
  • Article
  • Open Access
1 Citations
3,695 Views
14 Pages

Gradient-Based Metrics for the Evaluation of Image Defogging

  • Gerard deMas-Giménez,
  • Pablo García-Gómez,
  • Josep R. Casas and
  • Santiago Royo

Fog, haze, or smoke are standard atmospheric phenomena that dramatically compromise the overall visibility of any scene, critically affecting features such as the illumination, contrast, and contour detection of objects. The decrease in visibility co...

  • Article
  • Open Access
23 Citations
5,808 Views
26 Pages

14 August 2025

Multiclass evaluation metrics derived from the confusion matrix—such as accuracy, precision, and recall—are widely used yet rarely formalized with respect to their structural invariance. This paper introduces a closed-form analytical fram...

  • Review
  • Open Access
5 Citations
6,799 Views
33 Pages

14 January 2022

Conversational systems are now applicable to almost every business domain. Evaluation is an important step in the creation of dialog systems so that they may be readily tested and prototyped. There is no universally agreed upon metric for evaluating...

  • Article
  • Open Access
2 Citations
3,632 Views
22 Pages

12 July 2022

Today, students at universities in advanced countries typically enroll in colleges, such as the College of Education, which offer interdisciplinary programs for undergraduates in their first and second years, allowing them to explore personal interes...

(This article belongs to the Special Issue Sustainable Transition to Online Learning during Uncertain Times)
  • Article
  • Open Access
1 Citations
1,228 Views
14 Pages

Reference-Free Evaluation Metric for Fine-Grained 3D Shape Editing

  • JiangDong Miao,
  • Bisser Raytchev,
  • Takuji Nakashima,
  • Takenori Hiraoka and ,
  • Keigo Shimizu,
  • Yanlei Gu and
  • Toru Higaki
  • + 2 authors+ 0 author

10 December 2025

Evaluating the quality of fine-grained 3D shape editing, such as adjusting a vehicle’s roof length or wheelbase, is essential for assessing generative models but remains challenging. Most existing metrics depend on auxiliary regressors or large...

(This article belongs to the Special Issue Integration of AI in Signal and Image Processing)
  • Article
  • Open Access
11 Citations
3,017 Views
14 Pages

6 February 2024

In this study, the uncertainty in runoff simulations using hydrological models was quantified based on the selection of five evaluation metrics and calibration data length. The calibration data length was considered to vary from 1 to 11 years, and ru...

(This article belongs to the Topic Hydrology and Water Resources Management)
  • Article
  • Open Access
4 Citations
2,708 Views
23 Pages

31 January 2024

This paper presents a new approach called EmbedHDP, which aims to enhance the evaluation models utilized for assessing sentence suggestions in nursing care record applications. The primary objective is to determine the alignment of the proposed evalu...

  • Article
  • Open Access
3,204 Views
33 Pages

21 October 2025

Background: Knowledge distillation (KD) compresses deep neural networks by transferring knowledge from a high-capacity teacher model to a lightweight student model. However, conventional evaluation metrics such as accuracy, mAP, IoU, or RMSE focus ma...

  • Article
  • Open Access
441 Views
29 Pages

29 July 2026

This study evaluates four assessment approaches—questionnaire-based evaluation, Quantitative Content Analysis (QCA), visual summary, and machine learning-based image analysis—for quantifying infographic style in cartographic products. The...

(This article belongs to the Special Issue Advances in Geostatistical Information Analysis and Mapping)
  • Article
  • Open Access
33 Citations
16,727 Views
35 Pages

18 September 2018

An eye tracker’s accuracy and system behavior play critical roles in determining the reliability and usability of eye gaze data obtained from them. However, in contemporary eye gaze research, there exists a lot of ambiguity in the definitions o...

(This article belongs to the Section Physical Sensors)
  • Article
  • Open Access
807 Views
18 Pages

13 March 2026

Infrared image colorization has gained widespread attention in recent years as an important means of enhancing image visibility and semantic expression. However, existing evaluation methods mostly rely on pixel-level differences or feature distributi...

(This article belongs to the Special Issue AI-Based Visual Sensing for Object Detection)
  • Article
  • Open Access
2 Citations
2,279 Views
14 Pages

Evaluating Image Quality Metrics as Loss Functions for Image Dehazing

  • Rareș Dobre-Baron,
  • Adrian Savu-Jivanov and
  • Cosmin Ancuți

1 August 2025

The difficulty and manual nature of procuring human evaluators for ranking the quality of images affected by various types of degradations, and of those cleaned up by developed algorithms, has lead to the widespread adoption of automated metrics, lik...

(This article belongs to the Special Issue Sensing and Imaging in Computer Vision)
  • Article
  • Open Access
80 Views
40 Pages

18 November 2026

Published results for process-level anomaly detection on the HIL-based Augmented ICS (HAI) dataset range from below 0.3 to above 0.95. This extended version of a conference paper, which reported an accuracy of 0.9996 for a Long Short-Term Memory (LST...

  • Article
  • Open Access
1 Citations
3,517 Views
13 Pages

Fault localization remains a critical challenge in software engineering, directly impacting debugging efficiency and software quality. This study investigates the predictive power of various software metrics for fault localization by framing the task...

(This article belongs to the Special Issue Best Practices, Challenges and Opportunities in Software Engineering)
  • Article
  • Open Access
28 Citations
4,139 Views
23 Pages

Evaluation of Wind Energy Potential Using an Optimum Approach based on Maximum Distance Metric

  • Mehr Gul,
  • Nengling Tai,
  • Wentao Huang,
  • Muhammad Haroon Nadeem and
  • Moduo Yu

5 March 2020

The integration of wind power as an alternative energy source has gotten much attention globally. In this paper, the Weibull distribution model based on different artificial intelligent algorithms and numerical methods is used to evaluate the wind pr...

(This article belongs to the Section Energy Sustainability)
  • Article
  • Open Access
2 Citations
3,593 Views
15 Pages

LLMs in Action: Robust Metrics for Evaluating Automated Ontology Annotation Systems

  • Ali Noori,
  • Pratik Devkota,
  • Somya D. Mohanty and
  • Prashanti Manda

14 March 2025

Ontologies are critical for organizing and interpreting complex domain-specific knowledge, with applications in data integration, functional prediction, and knowledge discovery. As the manual curation of ontology annotations becomes increasingly infe...

(This article belongs to the Special Issue Biomedical Natural Language Processing and Text Mining)
  • Article
  • Open Access
27 Citations
8,547 Views
27 Pages

26 May 2014

Vegetation phenology plays an important role in regulating processes of terrestrial ecosystems. Dynamic ecosystem models (DEMs) require representation of phenology to simulate the exchange of matter and energy between the land and atmosphere. Locatio...

(This article belongs to the Special Issue Earth Observation for Ecosystems Monitoring in Space and Time)
  • Article
  • Open Access
9 Citations
5,892 Views
13 Pages

Currently available 360° cameras normally capture several images covering a scene in all directions around a shooting point. The captured images are spherical in nature and are mapped to a two-dimensional plane using various projection methods. Many...

(This article belongs to the Section Image and Video Processing)
  • Article
  • Open Access
3 Citations
3,330 Views
27 Pages

15 December 2021

Trust and confidence in autonomous behavior is required to send autonomous vehicles into operational missions. The authors introduce the Performance Evaluation and Review Framework Of Robotic Missions (PERFORM), a framework to enable a rigorous and r...

(This article belongs to the Section Robotics and Automation)
  • Article
  • Open Access
5 Citations
4,078 Views
19 Pages

Evaluating Mathematical Concordance Between Taxonomic and Functional Diversity Metrics in Benthic Macroinvertebrate Communities

  • Gonzalo Sotomayor,
  • Henrietta Hampel,
  • Raúl F. Vázquez,
  • Christine Van der heyden and ,
  • Marie Anne Eurie Forio and
  • Peter L. M. Goethals
  • + 1 author+ 0 author

13 June 2025

Understanding the structural concordance between taxonomic and functional diversity (FD) metrics is essential for improving the ecological interpretation of community patterns in biomonitoring programs. This study evaluated the concordance between ta...

(This article belongs to the Section Conservation Biology and Biodiversity)
  • Review
  • Open Access
85 Citations
25,403 Views
49 Pages

Evaluating Trustworthiness in AI: Risks, Metrics, and Applications Across Industries

  • Aleksandra Nastoska,
  • Bojana Jancheska,
  • Maryan Rizinski and
  • Dimitar Trajanov

Ensuring the trustworthiness of artificial intelligence (AI) systems is critical as they become increasingly integrated into domains like healthcare, finance, and public administration. This paper explores frameworks and metrics for evaluating AI tru...

(This article belongs to the Special Issue Navigating the Digital Age: Security, Ethics and Trust in Emerging Technologies)
  • Review
  • Open Access
4 Citations
3,056 Views
24 Pages

A Review of 3D Shape Descriptors for Evaluating Fidelity Metrics in Digital Twin

  • Md Tarique Hasan Khan,
  • Soonhung Han,
  • Tahir Abbas Jauhar and
  • Chiho Noh

22 August 2025

Digital Twin (DTw) technology is a cornerstone of Industry 4.0, enabling real-time monitoring, predictive maintenance, and performance optimization across diverse industries. A key requirement for effective DTw implementation is high geometric fideli...

(This article belongs to the Special Issue Artificial Intelligence and Robotics in Manufacturing and Automation)
  • Article
  • Open Access
4 Citations
3,660 Views
20 Pages

18 March 2023

Color 3D printing has been widely used in many fields such as cultural, medical, industrial, and food. The color reproduction accuracy of 3D printed products in these fields is becoming increasingly demanding, which requires more reproduction methods...

(This article belongs to the Section Manufacturing Processes and Systems)
  • Article
  • Open Access
8 Citations
4,100 Views
35 Pages

Spectral- and Image-Based Metrics for Evaluating Cleaning Tests on Unvarnished Painted Surfaces

  • Jan Dariusz Cutajar,
  • Calin Constantin Steindal,
  • Francesco Caruso,
  • Edith Joseph and
  • Tine Frøysaker

15 August 2024

Despite advances in conservation–restoration treatments, most surface cleaning tests are subjectively evaluated. Scores according to qualitative criteria are employed to assess results, but these can vary by user and context. This paper present...

(This article belongs to the Special Issue Heritage Conservation and Restoration: Surface Characterization, Cleaning and Treatments)
  • Technical Note
  • Open Access
5 Citations
3,059 Views
17 Pages

Evaluating Remote Sensing Metrics for Land Surface Phenology in Peatlands

  • Michal Antala,
  • Anshu Rastogi,
  • Marcin Stróżecki,
  • Mar Albert-Saiz and ,
  • Subhajit Bandopadhyay and
  • Radosław Juszczak
  • + 1 author+ 0 author

26 December 2024

Vegetation phenology is an important indicator of climate change and ecosystem productivity. However, the monitoring of vegetation generative phenology through remote sensing techniques does not allow for species-specific retrieval in mixed ecosystem...

(This article belongs to the Section Environmental Remote Sensing)
  • Article
  • Open Access
16 Citations
3,888 Views
15 Pages

18 March 2024

The advancement of deep learning in human activity recognition (HAR) using 3D skeleton data is critical for applications in healthcare, security, sports, and human–computer interaction. This paper tackles a well-known gap in the field, which is...

(This article belongs to the Special Issue AI-Enabled Sensing Technology and Data Analysis Techniques for Intelligent Human-Computer Interaction)
  • Article
  • Open Access
8 Citations
8,365 Views
10 Pages

27 September 2011

Planners, designers, citizens, and governmental agencies are interested in creating environments that are sustainable and fulfill a wide range of economic, ecological, aesthetic, functional, and cultural expectations for stakeholders. There are numer...

(This article belongs to the Special Issue Challenges in City Design: Realize the Value of Cities)
  • Article
  • Open Access
7 Citations
3,547 Views
16 Pages

Evaluating Medical Text Summaries Using Automatic Evaluation Metrics and LLM-as-a-Judge Approach: A Pilot Study

  • Yuriy Vasilev,
  • Irina Raznitsyna,
  • Anastasia Pamova,
  • Tikhon Burtsev and ,
  • Tatiana Bobrovskaya,
  • Pavel Kosov,
  • Anton Vladzymyrskyy,
  • Olga Omelyanskaya and
  • Kirill Arzamasov
  • + 4 authors+ 0 author

Background: Electronic health records (EHRs) remain a vital source of clinical information, yet processing these heterogeneous data is extremely labor-intensive. Summarization of these data using Large Language Models (LLMs) is considered a promising...

(This article belongs to the Section Machine Learning and Artificial Intelligence in Diagnostics)
  • Article
  • Open Access
40 Citations
15,471 Views
19 Pages

Evaluating Performance Measurement Metrics for Lean and Agile Supply Chain Strategies in Large Enterprises

  • Benameur Dahinine,
  • Abderrazak Laghouag,
  • Wassila Bensahel,
  • Majed Alsolamy and
  • Tarek Guendouz

21 March 2024

Previous research has identified metrics that are applicable to both lean and agile strategies and has hypothesised that financial and efficiency metrics are more relevant to the lean supply chain strategy, while customer service and flexibility metr...

(This article belongs to the Special Issue Supply Chain Performance Measurement in Industry 4.0)
  • Article
  • Open Access
3 Citations
7,545 Views
18 Pages

Evaluating Main Canal and Barrage Performance in Pakistan through Water Security Metrics

  • Dileep Kumar,
  • Usman Safder,
  • Waqas Ahmed Pathan and
  • Kamran Ansari

24 October 2023

The present study provides an in-depth investigation into water security using socio-hydrological analysis by investigating the relationship between irrigation entitlements and actual water delivery. Conjoint analysis is used to evaluate the reliabil...

(This article belongs to the Section Water and One Health)
  • Article
  • Open Access
354 Views
26 Pages

Evaluating Dynamic and Static GNSS-Derived PWV Metrics for Heavy Rainfall Characterization in Cyprus

  • Despina Giannadaki,
  • Christina Oikonomou,
  • Nikolas Aristotelous and
  • Haris Haralambous

18 August 2026

Global Navigation Satellite System (GNSS)-derived precipitable water vapor (PWV) has become an important source of atmospheric moisture information for severe weather monitoring. While previous studies have primarily relied on static GNSS-derived PWV...

(This article belongs to the Section Atmospheric Techniques, Instruments, and Modeling)
  • Article
  • Open Access
2 Citations
2,812 Views
17 Pages

As large scale digitization continues to reform business processes, one critical challenge organizations are currently facing is managing the staggering amount of data flowing. Further, with large datasets comes the added complexity of insuring a cyb...

(This article belongs to the Special Issue Current Trends in Data Security and Privacy—2nd Edition)
  • Article
  • Open Access
6 Citations
3,380 Views
19 Pages

Evaluating the Environmental Quality of Forest Remnants Using Landscape Metrics

  • Regina Márcia Longo,
  • Alessandra Leite da Silva,
  • Admilson Irio Ribeiro,
  • Raissa Caroline Gomes and ,
  • Fabricio Camillo Sperandio and
  • Adélia N. Nunes
  • + 1 author+ 0 author

12 February 2024

Forest remnants are hotspots of biodiversity and play an important role in providing services such as regulating the climate, reducing surface runoff, helping erosion control, protecting and contributing to the balance of ecosystems, and other functi...

(This article belongs to the Special Issue Urban Landscapes, Forestry and Green Infrastructure: From a Sustainable Perspective)
  • Article
  • Open Access
6 Citations
3,611 Views
16 Pages

The Internet of Things (IoT) networks face an increasing number of cyber threats due to their heterogeneous, distributed, and resource-constrained nature. Conventional static defense mechanisms are often inadequate against sophisticated and advanced...

(This article belongs to the Special Issue Navigating the Digital Age: Security, Ethics and Trust in Emerging Technologies)
  • Article
  • Open Access
242 Citations
22,401 Views
20 Pages

5 March 2021

Accuracy metrics have been widely used for the evaluation of predictions in machine learning. However, the selection of an appropriate accuracy metric for the evaluation of a specific prediction has not yet been specified. In this study, seven of the...

  • Article
  • Open Access
22 Citations
8,162 Views
20 Pages

Suitability of Data-Collection Methods, Tools, and Metrics for Evaluating Market Food Environments in Low- and Middle-Income Countries

  • Selena Ahmed,
  • Gina Kennedy,
  • Jennifer Crum,
  • Chris Vogliano and ,
  • Sarah McClung and
  • Collin Anderson
  • + 1 author+ 0 author

8 November 2021

Globalization is transforming food environments in low- and middle-income countries (LMICs) with implications for diets and nutrition. However, most food-environment assessments were developed for use in high-income countries. We evaluated the suitab...

(This article belongs to the Special Issue Advancing Healthy Food Environments for Sustainable Diets in a Changing World)
  • Review
  • Open Access
105 Citations
11,539 Views
38 Pages

Evaluation Metrics for Wind Power Forecasts: A Comprehensive Review and Statistical Analysis of Errors

  • Paweł Piotrowski,
  • Inajara Rutyna,
  • Dariusz Baczyński and
  • Marcin Kopyt

19 December 2022

Power generation forecasts for wind farms, especially with a short-term horizon, have been extensively researched due to the growing share of wind farms in total power generation. Detailed forecasts are necessary for the optimization of power systems...

(This article belongs to the Special Issue Intelligent Forecasting and Optimization in Electrical Power Systems)
  • Article
  • Open Access
30 Citations
8,619 Views
23 Pages

A Framework for Word Embedding Based Automatic Text Summarization and Evaluation

  • Tulu Tilahun Hailu,
  • Junqing Yu and
  • Tessfu Geteye Fantaye

31 January 2020

Text summarization is a process of producing a concise version of text (summary) from one or more information sources. If the generated summary preserves meaning of the original text, it will help the users to make fast and effective decision. Howeve...

(This article belongs to the Section Information Processes)
  • Review
  • Open Access
381 Views
35 Pages

Object-detection benchmark scores are often transferred across settings without restating the evaluation target that gives a metric its meaning. This focused interpretive review examines how that target changes along a scale-centered path from regula...

(This article belongs to the Section Data Mining and Machine Learning)
  • Article
  • Open Access
4 Citations
6,227 Views
21 Pages

Exploratory Analysis on Pixelwise Image Segmentation Metrics with an Application in Proximal Sensing

  • Paul Melki,
  • Lionel Bombrun,
  • Estelle Millet,
  • Boubacar Diallo and ,
  • Hakim ElChaoui ElGhor and
  • Jean-Pierre Da Costa
  • + 1 author+ 0 author

18 February 2022

A considerable number of metrics can be used to evaluate the performance of machine learning algorithms. While much work is dedicated to the study and improvement of data quality and models’ performance, much less research is focused on the stu...

(This article belongs to the Special Issue Advances of Remote Sensing in Precision Agriculture)
  • Review
  • Open Access
685 Views
42 Pages

26 August 2026

Increasing variability in electricity production and demand contributes to greater electricity price volatility across different markets. The effective implementation of business processes related to broadly defined electricity trading therefore requ...

(This article belongs to the Section F1: Electrical Power System)
  • Article
  • Open Access
8 Citations
5,345 Views
15 Pages

A Benchmark for the Evaluation of Corner Detectors

  • Yang Zhang,
  • Baojiang Zhong and
  • Xun Sun

23 November 2022

Corners are an important kind of image feature and play a crucial role in solving various tasks. Over the past few decades, a great number of corner detectors have been proposed. However, there is no benchmark dataset with labeled ground-truth corner...

(This article belongs to the Collection Computer Vision and Machine Learning: Theory, Methods and Applications)

of 380