Skip to Content

16,889 Results Found

  • Article
  • Open Access
8 Citations
6,888 Views
21 Pages

Evaluating Uncertainties in Marine Biogeochemical Models: Benchmarking Aerosol Precursors

  • Oluwaseun O. Ogunro,
  • Scott M. Elliott,
  • Oliver W. Wingenter,
  • Clara Deal and ,
  • Weiwei Fu,
  • Nathan Collier and
  • Forrest M. Hoffman
  • + 2 authors+ 0 author

The effort to accurately estimate global radiative forcing has long been hampered by a degree of uncertainty in the tropospheric aerosol contribution. Reducing uncertainty in natural aerosol processes, the baseline of the aerosol budget, thus becomes...

(This article belongs to the Special Issue Ocean Contributions to the Marine Boundary Layer Aerosol Budget)
  • Article
  • Open Access
1,316 Views
20 Pages

Towards Improved Clinical Adoption of AI Segmentation Models: Benchmarking High-Performance Models for Resource-Constrained Settings

  • Emmanuel Chibuikem Nnadozie,
  • Susana Merino-Caviedes,
  • Daniel A. de Luis-Román,
  • Marcos Martín-Fernández and
  • Carlos Alberola-López

High-performance medical segmentation models are often benchmarked on high-end GPUs. Such benchmarks do not provide useful performance insights for point-of-care low-end devices. This work, firstly, posits that to achieve improved clinical adoption o...

(This article belongs to the Special Issue Next-Generation Medical Image Analysis: Multimodal, Decentralized, Fair and Reasoning-Centric Approaches)
  • Article
  • Open Access
7 Citations
4,908 Views
20 Pages

4 March 2020

In most cases, the benchmarking models of energy use in houses are developed based on current and past data, and they continue to be used without any update. This paper proposes the method of retraining of benchmarking models by applying machine lear...

(This article belongs to the Special Issue Energy Efficiency, Savings and Storage in Buildings Combined with Advanced Energy Systems and Materials)
  • Article
  • Open Access
23 Citations
10,834 Views
17 Pages

Benchmarking Machine Learning Models to Assist in the Prognosis of Tuberculosis

  • Maicon Herverton Lino Ferreira da Silva Barros,
  • Geovanne Oliveira Alves,
  • Lubnnia Morais Florêncio Souza,
  • Elisson da Silva Rocha and ,
  • João Fausto Lorenzato de Oliveira,
  • Theo Lynn,
  • Vanderson Sampaio and
  • Patricia Takako Endo
  • + 3 authors+ 0 author

Tuberculosis (TB) is an airborne infectious disease caused by organisms in the Mycobacterium tuberculosis (Mtb) complex. In many low and middle-income countries, TB remains a major cause of morbidity and mortality. Once a patient has been diagnosed w...

(This article belongs to the Section Machine Learning)
  • Article
  • Open Access
4 Citations
1,855 Views
35 Pages

Cross-Dataset Benchmarking of Deep Learning Models for Surface Defect Classification in Metal Parts

  • Fábio Mendes da Silva,
  • João Manuel R. S. Tavares,
  • António Mendes Lopes and
  • Antonio Ramos Silva

20 March 2026

Accurate surface defect classification is critical for industrial quality control. Although Deep Learning achieves strong results on individual datasets, most prior studies benchmark only a narrow set of models under inconsistent pipelines, limiting...

(This article belongs to the Special Issue Intelligent Automation and Robotics for Future Factories: Vision Systems, Artificial Intelligence, and Machine Engineering)
  • Article
  • Open Access
192 Views
87 Pages

2 November 2026

Large language models (LLMs) are adopted in financial services, yet existing benchmarks provide limited insight into financial-domain capability, regulatory compliance-action performance, and security robustness. This study proposes a unified multidi...

(This article belongs to the Special Issue FinTech and Financial Stability: Opportunities and Risks)
  • Article
  • Open Access
1 Citations
1,217 Views
26 Pages

System logs are essential for monitoring and diagnosing modern computing infrastructure; however, their scale and complexity require reliable automated interpretation. Although severity levels are predefined metadata, treating classification as an en...

(This article belongs to the Special Issue Trustworthy and Efficient Large Language Models: Methods, Systems and Applications)
  • Article
  • Open Access
5 Citations
2,641 Views
26 Pages

Benchmarking Standard and Micromechanical Models for Creep and Shrinkage of Concrete Relevant for Nuclear Power Plants

  • Vít Šmilauer,
  • Lenka Dohnalová,
  • Milan Jirásek,
  • Julien Sanahuja and ,
  • Suresh Seetharam and
  • Saeid Babaei
  • + 1 author+ 0 author

18 October 2023

The creep and shrinkage of concrete play important roles for many nuclear power plant (NPP) and engineering structures. This paper benchmarks the standard and micromechanical models using a revamped and appended Northwestern University database of la...

(This article belongs to the Section Construction and Building Materials)
  • Article
  • Open Access
385 Views
31 Pages

22 October 2026

Large language models (LLMs) are increasingly proposed for Building Information Modeling (BIM) work, yet published evaluations test one or two models on a single task using simplified inputs, leaving practitioners without an evidence base for choosin...

(This article belongs to the Special Issue Generative AI in Architecture, Engineering and Construction: Innovations and Applications)
  • Proceeding Paper
  • Open Access
4 Citations
11,442 Views
10 Pages

Recently, time-series forecasting foundation models trained on large, diverse datasets have demonstrated robust zero-shot and few-shot capabilities. Given the ubiquity of time-series data in IoT, finance, and industrial applications, rigorous benchma...

(This article belongs to the Proceedings of The 11th International Conference on Time Series and Forecasting)
  • Article
  • Open Access
6 Citations
4,184 Views
31 Pages

25 November 2024

Related to microelectronics’ reliability, lifetime estimation methods have gained importance, especially for surface-mounted devices. The virtual testing of electronic assemblies necessitates the geometry modeling and finite element analysis of...

(This article belongs to the Special Issue Early Career Scientists’ (ECS) Contributions to Applied Mechanics (2nd Edition))
  • Review
  • Open Access
45 Citations
26,400 Views
31 Pages

A Survey of Large Language Models: Evolution, Architectures, Adaptation, Benchmarking, Applications, Challenges, and Societal Implications

  • Seyed Mahmoud Sajjadi Mohammadabadi,
  • Burak Cem Kara,
  • Can Eyupoglu,
  • Can Uzay and ,
  • Mehmet Serkan Tosun and
  • Oktay Karakuş
  • + 1 author+ 0 author

9 September 2025

This survey provides an in-depth review of large language models (LLMs), highlighting the significant paradigm shift they represent in artificial intelligence. Our purpose is to consolidate state-of-the-art advances in LLM design, training, adaptatio...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
246 Views
22 Pages

Accurate liquefied petroleum gas (LPG) price forecasts are relevant to procurement and inventory planning, yet regional differences within China have received limited attention. This empirical study benchmarks 16 learned time-series models and a Naiv...

(This article belongs to the Section Power and Energy Forecasting)
  • Article
  • Open Access
247 Views
41 Pages

27 September 2026

While recent advancements in large-scale pretraining have significantly improved dense geometric models, these architectures often struggle to adapt to 4K-resolution inputs because of their rigidity. Existing benchmarks mostly provide low-resolution...

(This article belongs to the Special Issue AI4Data and Data4AI: Data Intelligence for Foundation Models, Knowledge Systems, and Intelligent Agents)
  • Article
  • Open Access
5 Citations
3,737 Views
20 Pages

16 January 2026

A growing challenge in mobile robotics is the reliance on complex graphical interfaces and rigid control pipelines, which limit accessibility for non-expert users. This work introduces a latency-aware benchmarking framework that enables natural-langu...

(This article belongs to the Special Issue Multimodal Sensing, Fusion, and VLMs for Scene Understanding and Robot Vision)
  • Article
  • Open Access
686 Views
31 Pages

The Socratic Trap: Benchmarking the Capacity of Large Language Models to Generate Strategic Misconceptions in Computer Science Education

  • Marijela Miličević,
  • Mia Rovis,
  • Ratomir Karlović,
  • Sandi Baressi Šegota and ,
  • Vedran Mrzljak,
  • Ivan Lorencin and
  • Darko Etinger
  • + 2 authors+ 0 author

21 July 2026

Large language models (LLMs) are increasingly integrated into educational settings, yet their pedagogical reliability remains insufficiently understood. Beyond overt hallucinations, which informed users readily recognize, a subtler failure mode consi...

(This article belongs to the Special Issue Advancing Educational Innovation with Artificial Intelligence)
  • Article
  • Open Access
579 Views
31 Pages

Machine learning should be judged by how well it predicts, and computational resources are not accounted for in predictive accuracy. Given the growing emphasis on energy consumption and resource efficiency, decision-supporting frameworks should go be...

(This article belongs to the Special Issue Innovative Machine Learning Technologies and Applications)
  • Article
  • Open Access
165 Views
34 Pages

Benchmarking Open-Source Large Language Models for Breast Ultrasound Report Processing: A Multicenter Study

  • Ye Cheng,
  • Ruixin Wang,
  • Xihao Hong,
  • Can Wang and ,
  • Yue Yin,
  • Jinghang Wang,
  • Xiaohui Liu,
  • Longtao Yang,
  • Lishan Yi and
  • Zhiyuan Wang
  • + 6 authors+ 1 author

26 October 2026

Background/Objectives: General-purpose large language models (LLMs) may support medical reporting, but their role in breast ultrasound (BUS) workflows remains uncertain. We evaluated locally deployable open-source LLMs for BUS report quality control,...

(This article belongs to the Section Machine Learning and Artificial Intelligence in Diagnostics)
  • Article
  • Open Access
287 Views
27 Pages

2 November 2026

Few-shot adaptation of vision–language models (VLMs) could reduce the labeling effort for defect screening in scanning electron microscopy (SEM) of polymer electrolyte membrane (PEM) fuel-cell materials. We built a leakage-controlled benchmark...

(This article belongs to the Special Issue Artificial Intelligence for Battery Health, Safety, and Lifetime Management in Electric Vehicles)
  • Article
  • Open Access
2,435 Views
23 Pages

The growing number of domain-specific machine learning benchmarks has driven methodological progress, yet real-world deployments require a different evaluation approach. Model-aware synthetic benchmarks, designed to emphasize failure modes of existin...

  • Feature Paper
  • Article
  • Open Access
10 Citations
5,886 Views
19 Pages

In the field of hydrology, event-based models are commonly used for flood-flow prediction in catchments, for use in flood forecasting, flood risk assessment, and infrastructure design. The models are simplistic, as they do not consider longer-term ca...

(This article belongs to the Special Issue New Perspectives in the Flood Forecasting Chain (Weather Prediction, Rainfall-Runoff Modeling, and Communication with Stakeholders))
  • Article
  • Open Access
404 Views
14 Pages

3 September 2026

Plant taxonomic knowledge contains a long tail of infrequently encountered names, diagnostic characters, and nomenclatural decisions, yet model reliability across this distribution remains unclear. We developed the Chinese-language PTTB-600, comprisi...

(This article belongs to the Section Plant Diversity)
  • Article
  • Open Access
1 Citations
5,433 Views
25 Pages

Benchmarking with a Language Model Initial Selection for Text Classification Tasks

  • Agus Riyadi,
  • Mate Kovacs,
  • Uwe Serdült and
  • Victor Kryssanov

The now-globally recognized concerns of AI’s environmental implications resulted in a growing awareness of the need to reduce AI carbon footprints, as well as to carry out AI processes responsibly and in an environmentally friendly manner. Benc...

(This article belongs to the Section Data)
  • Article
  • Open Access
5 Citations
3,612 Views
20 Pages

A Model for Streamlining Benchmarking in Sustainable Development of Industries

  • Lucia Bednárová,
  • Tomáš Bakalár,
  • Henrieta Pavolová,
  • Radim Rybár and
  • Zuzana Šimková

21 March 2024

Benchmarking is a process of improving organizational performance by recognizing, comprehending, adjusting, and incorporating the most effective practices and procedures observed either within or outside an organization. Benchmarking creates, primari...

(This article belongs to the Section Economic and Business Aspects of Sustainability)
  • Article
  • Open Access
6 Citations
3,857 Views
19 Pages

Finite Element Models of a Benchmark Footbridge

  • Fiammetta Venuti,
  • Marco Domaneschi,
  • Marc Lizana and
  • Branko Glisic

28 September 2021

Modern footbridges are often lively structures, characterized by natural frequencies that fall in the range of pedestrian activities, such as walking, running, and jumping. Therefore, serviceability assessment under human-induced excitation is crucia...

(This article belongs to the Special Issue Human Factors in Transportation Systems)
  • Article
  • Open Access
5 Citations
4,745 Views
20 Pages

Concrete dams are massive unreinforced quasi-brittle structures prone to cracking from multiple causes. The structural safety assessment of cracked concrete dams is typically performed using computational analysis through numerical methods, with adeq...

(This article belongs to the Special Issue Advances in Dam Engineering of the 21st Century)
  • Review
  • Open Access
1 Citations
3,895 Views
63 Pages

Large Language Model Benchmarks: A Taxonomy of Capabilities, Scientific Quality Assessment, and Saturation Analysis

  • Rubén Gómez,
  • Carlos E. Miranda,
  • Julio-Alejandro Romero-González,
  • Diana-Margarita Córdova-Esparza and ,
  • Gendry Alfonso-Francia,
  • Edgar-Arturo Chávez-Urbiola,
  • Alfonso Ramirez-Pedraza and
  • Juan Terven
  • + 3 authors+ 0 author

The rapid evolution of Large Language Models (LLMs) has exposed limitations of static, accuracy-oriented benchmarks and increased the need for evaluation frameworks that distinguish among capabilities and benchmark quality. This survey analyzes 63 LL...

(This article belongs to the Section Thematic Reviews)
  • Article
  • Open Access
3 Citations
2,446 Views
13 Pages

Scalable Model-Based Diagnosis with FastDiag: A Dataset and Parallel Benchmark Framework

  • Delia Isabel Carrión León,
  • Cristian Vidal-Silva and
  • Nicolás Márquez

3 September 2025

FastDiag is a widely used algorithm for model-based diagnosis, computing minimal subsets of constraints whose removal restores consistency in knowledge-based systems. As applications grow in complexity, researchers have proposed parallel extensions s...

  • Article
  • Open Access
569 Views
14 Pages

Background/Objectives: To characterize the zero-shot diagnostic behavior of three commercial multimodal large language models (MLLMs) on cardiopulmonary chest radiograph findings and to assess sex-stratified performance differences. Methods: GPT-5.4,...

(This article belongs to the Section Machine Learning and Artificial Intelligence in Diagnostics)
  • Article
  • Open Access
442 Views
17 Pages

Bench of Euler: A Benchmark for Evaluating the Problem-Solving Abilities of Large Language Models

  • Anurag Dutta,
  • S. Shanmuga Priya,
  • A. Ramamoorthy and
  • Pijush Kanti Kumar

Large language models (LLMs) have recently improved their problem-solving abilities and can solve complex mathematical problems with an increasing accuracy, necessitating the development of more challenging benchmarks. Over the years, the performance...

(This article belongs to the Special Issue Large Language Models and Applications)
  • Article
  • Open Access
447 Views
18 Pages

MetSEval-1k: A Comprehensive Benchmark for Evaluating Large Language Models in Meteorology

  • Tingzhao Yu,
  • Kuoyin Wang,
  • Zhimin Li,
  • Muhua Wang and ,
  • Yu Chen,
  • Hui Chen,
  • Rui Zhao,
  • Yucheng Xu,
  • Yingying Song and
  • Baowen Xu
  • + 5 authors+ 0 author

12 August 2026

This paper proposes METMAP, a comprehensive 6D evaluation framework designed to assess large language models in meteorological applications. The framework encompasses six critical capabilities including meteorological knowledge comprehension, expert-...

  • Article
  • Open Access
1 Citations
1,902 Views
43 Pages

14 February 2026

With the growth of large language models (LLMs), there are increasing calls to interpret their behavior through the prism of analogies to human cognitive mechanisms. At the same time, scientific literature points to the fundamental limitations of the...

  • Article
  • Open Access
18 Citations
8,884 Views
44 Pages

6 February 2025

Large language models (LLMs) and generative artificial intelligence (AI) have demonstrated notable capabilities, achieving human-level performance in intelligent tasks like medical exams. Despite the introduction of extensive LLM evaluations and benc...

  • Article
  • Open Access
37 Citations
8,972 Views
16 Pages

Deep learning solutions are being increasingly used in mobile applications. Although there are many open-source software tools for the development of deep learning solutions, there are no guidelines in one place in a unified manner for using these to...

(This article belongs to the Section Learning)
  • Article
  • Open Access
1 Citations
1,501 Views
19 Pages

28 May 2026

Artificial intelligence foundation models are increasingly deployed for prostate cancer Gleason grading, where GP3/GP4 distinction directly impacts treatment decisions (active surveillance vs. intervention). However, these models may achieve high val...

  • Article
  • Open Access
1 Citations
1,819 Views
22 Pages

10 February 2026

Genomic Language Models (GLMs), leveraging their vast parameter scales and the similarities between DNA sequences and natural languages, demonstrate immense potential in processing large-scale genomic data and elucidating gene regulation and evolutio...

  • Article
  • Open Access
1 Citations
1,533 Views
29 Pages

Extending Q-Learning for Economic Modelling: A Design Framework with Equilibrium Benchmarks

  • Jorge Moya Velasco,
  • Jorge Soria Ruiz-Ogarrio,
  • Pedro Caja Meri and
  • Silvia Álvarez-Santás

This paper proposes a methodological architecture to integrate Q-learning into economic modelling systematically. It addresses a common gap: the lack of a shared framework linking economic foundations to Reinforcement Learning components. Rather than...

(This article belongs to the Special Issue Modern Applications for Computational Methods in Applied Economics and Business Engineering)
  • Article
  • Open Access
32 Citations
10,638 Views
25 Pages

Benchmarking Object Detection Deep Learning Models in Embedded Devices

  • David Cantero,
  • Iker Esnaola-Gonzalez,
  • Jose Miguel-Alonso and
  • Ekaitz Jauregi

31 May 2022

Object detection is an essential capability for performing complex tasks in robotic applications. Today, deep learning (DL) approaches are the basis of state-of-the-art solutions in computer vision, where they provide very high accuracy albeit with h...

(This article belongs to the Special Issue Recognition Robotics)
  • Feature Paper
  • Review
  • Open Access
2 Citations
1,366 Views
19 Pages

6 August 2024

This work (in two parts) will review the recently developed predictive modeling methodology called “4th-BERRU-PM” and its applicability to nuclear energy systems as exemplified by an illustrative application to the Polyethylene-Reflected...

(This article belongs to the Section K: State-of-the-Art Energy Related Technologies)
  • Article
  • Open Access
8 Citations
5,690 Views
19 Pages

21 March 2022

In this article, multi-fidelity kriging and sparse polynomial chaos expansion (SPCE) surrogate models are constructed. In addition, a novel combination of the two surrogate approaches into a multi-fidelity SPCE-Kriging model will be presented. Accura...

(This article belongs to the Special Issue Simulation-Based Optimization: Methods and Applications in Engineering Design)
  • Article
  • Open Access
18 Citations
3,797 Views
21 Pages

21 September 2021

Computational Fluid Dynamics (CFD) has become an indispensable tool that can potentially predict many phenomena of practical interest in the tundish. Model verification and validation (V&V) are essential parts of a CFD model development process i...

(This article belongs to the Section Manufacturing Processes and Systems)
  • Article
  • Open Access
4 Citations
6,556 Views
23 Pages

9 May 2025

Text-to-SQL leverages large language models (LLMs) for natural language database queries, yet existing benchmarks like BIRD (12,751 question–SQL pairs, 95 databases) suffer from inconsistencies—e.g., 30% of queries misalign with SQL outpu...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
1 Citations
1,486 Views
17 Pages

SADAMB: Advancing Spatially-Aware Vision-Language Modeling Through Datasets, Metrics, and Benchmarks

  • Giorgos Papadopoulos,
  • Petros Drakoulis,
  • Athanasios Ntovas,
  • Alexandros Doumanoglou and
  • Dimitris Zarpalas

29 September 2025

Understanding spatial relationships between objects in images is crucial for robotic navigation, augmented reality systems, and autonomous driving applications, among others. However, existing vision-language benchmarks often overlook explicit spatia...

(This article belongs to the Topic Visual Computing and Understanding: New Developments and Trends)
  • Article
  • Open Access
1 Citations
231 Views
19 Pages

AstroMMBench: A Benchmark for Evaluating Multimodal Large Language Model Capabilities in Astronomy

  • Jinghang Shi,
  • Xiaoyu Tang,
  • Yang Huang,
  • Yuyang Li and ,
  • Yanxia Zhang,
  • Xiao Kong,
  • Caizhan Yue and
  • A-Li Luo
  • + 3 authors+ 0 author

30 September 2026

Astronomical image interpretation requires not only visual perception, but also familiarity with domain-specific representations, observational conventions, and astrophysical reasoning. Although recent multimodal large language models (MLLMs) have sh...

(This article belongs to the Special Issue New Discoveries in Astronomical Data (II))
  • Article
  • Open Access
3 Citations
2,236 Views
26 Pages

Benchmarking LLM-as-a-Judge Models for 5W1H Extraction Evaluation

  • José Cassola-Bacallao,
  • José Morales-Donaire,
  • Paula Hernández-Montoya and
  • Brian Keith-Norambuena

Evaluating 5W1H (Who, What, When, Where, Why, and How) information extraction systems remains challenging, as traditional information retrieval metrics like ROUGE and BLEU fail to capture semantic accuracy and narrative coherence. The LLM-as-a-Judge...

(This article belongs to the Special Issue Multimodal Learning for Multimedia Content Analysis and Understanding)
  • Article
  • Open Access
32 Citations
6,266 Views
22 Pages

Custom Scanning Hyperspectral Imaging System for Biomedical Applications: Modeling, Benchmarking, and Specifications

  • José A. Gutiérrez-Gutiérrez,
  • Arturo Pardo,
  • Eusebio Real,
  • José M. López-Higuera and
  • Olga M. Conde

9 April 2019

Prototyping hyperspectral imaging devices in current biomedical optics research requires taking into consideration various issues regarding optics, imaging, and instrumentation. In summary, an ideal imaging system should only be limited by exposure t...

(This article belongs to the Section Physical Sensors)
  • Article
  • Open Access
3 Citations
1,311 Views
47 Pages

26 December 2025

The control of wastewater treatment plants (WWTPs) is an ecologically, economically, and socially important objective. In the case of plants using activated sludge (ASP) processes, their control presents a significant challenge due to the complexity...

(This article belongs to the Special Issue AI in Wastewater Treatment)
  • Article
  • Open Access
2 Citations
2,461 Views
28 Pages

12 February 2026

Large language models (LLMs) have shown remarkable progress in general reasoning and understanding, but their ability to perform formal logical reasoning remains under-explored. In this paper, we introduce DLReasonSuite, a novel benchmark designed to...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
2 Citations
934 Views
20 Pages

Constrained Multibody Dynamic Modeling and Power Benchmarking of a Three-Omni-Wheel Mobile Robot

  • Iosif-Adrian Maroșan,
  • Sever-Gabriel Racz,
  • Radu-Eugen Breaz,
  • Alexandru Bârsan and ,
  • Claudia-Emilia Gîrjob,
  • Mihai Crenganiș,
  • Cristina-Maria Biriș and
  • Anca-Lucia Chicea
  • + 3 authors+ 0 author

5 April 2026

Omnidirectional mobile robots are increasingly used in industrial and service applications due to their high maneuverability and ability to perform combined translational and rotational motions in confined spaces. However, these locomotion advantages...

(This article belongs to the Section Industrial Systems)
  • Article
  • Open Access
632 Views
45 Pages

Do Complex Forecasting Models Beat Simple Benchmarks? A Small-Sample Case Study of Wheat, Corn, and Soybean Prices

  • Sergio Orozco Cirilo,
  • Juan Manuel Vargas-Canales,
  • Dora María Sangerman Jarquín,
  • Juan Antonio Bautista and ,
  • Sergio Ernesto Medina Cuéllar,
  • Alberto Valdes Cobos,
  • Benito Rodríguez Haros and
  • Belén Hernández Hernández
  • + 3 authors+ 0 author

25 September 2026

Many studies report forecasting gains for sophisticated machine-learning and deep-learning models without testing whether those gains survive comparison against simple, reproducible benchmarks. This study tests that question for one-step-ahead monthl...

(This article belongs to the Special Issue Benchmark Models in Time Series Forecasting)

of 338