Publications

9 pages, 176 KB

Open AccessEssay

Interpreting Bibliometric Indicators as the “Blood Tests” of Research Systems

by Tindaro Cicero

Publications 2026, 14(1), 9; https://doi.org/10.3390/publications14010009 - 28 Jan 2026

Viewed by 142

The increasing emphasis on responsible research assessment has renewed the need for conceptual tools that help communicate the complementary roles of quantitative and qualitative evaluation. This essay proposes an interpretative metaphor that frames bibliometric indicators as the “blood tests” of research systems—heuristic devices [...] Read more.

The increasing emphasis on responsible research assessment has renewed the need for conceptual tools that help communicate the complementary roles of quantitative and qualitative evaluation. This essay proposes an interpretative metaphor that frames bibliometric indicators as the “blood tests” of research systems—heuristic devices that reveal multidimensional aspects of system vitality, balance, and dysfunction. The metaphor, grounded in standard categories of clinical diagnostics (hematological, hepatic, renal, lipidic, and cardiovascular panels), provides an accessible language for scholars and policymakers in research. Each bibliometric technique—ranging from publication and citation counts to patent analysis, altmetrics, and topic modelling—is associated with a diagnostic function such as screening, monitoring, or early risk detection. By linking established principles of responsible metrics (DORA, Leiden Manifesto, Metric Tide, CoARA) with the professionalization of evaluators, the essay situates the metaphor within current debates on bibliometric literacy and the ethical interpretation of indicators. Rather than prescribing metrics or decision rules, the contribution invites reflection on how evaluators can interpret bibliometric signals diagnostically—as contextual evidence for institutional learning, strategic decision-making, and the cultivation of healthy, adaptive research systems. Consistent with the essay format, this contribution does not propose a new evaluative methodology nor empirical validation. Instead, it advances a heuristic and communicative framework intended to emphasize the holistic, contextual, and professionally informed interpretation of quantitative indicators in the evaluation of research activity. Full article

18 pages, 1651 KB

Open AccessArticle

The Penetration of Digital Methods into Historical Scholarship: A Text-Mining Analysis of Russian Publications

by Zinaida Sokova, Valery Kruzhinov and Anna Glazkova

Publications 2026, 14(1), 8; https://doi.org/10.3390/publications14010008 - 20 Jan 2026

Viewed by 213

Abstract

The integration of digital technologies into historical research is a global trend; however, its manifestation varies across national academic traditions. This study investigates the explicit articulation and terminological adoption of digital methods in Russian historical science by analyzing the prevalence and dynamics of [...] Read more.

The integration of digital technologies into historical research is a global trend; however, its manifestation varies across national academic traditions. This study investigates the explicit articulation and terminological adoption of digital methods in Russian historical science by analyzing the prevalence and dynamics of specific technological terms in a large corpus of publications. We first constructed a controlled thesaurus of 166 digital technologies by manually curating keyphrases from Russia’s primary specialized journal in the field (“Istoricheskaya Informatika”, Historical Informatics). This vocabulary was then used to perform text-mining on two distinct corpora: a broad sample of 95K Russian-language history articles from various journals (2004–2024) and a focused sample of publications on the Great Patriotic War History from the Russian Science Citation Index (RSCI, 2014–2023). Our quantitative analysis reveals the frequency, trends, and thematic context of digital method mentions. The findings highlight a significant disparity between the specialized discourse of “Istoricheskaya Informatika” and the mainstream historical publications, while also identifying specific areas (such as archaeological studies) where certain technologies have gained traction. This research offers a novel, data-driven perspective on the “digital turn” in Russian historiography and contributes to the comparative study of digital humanities’ global development. Full article

► Show Figures

Figure 1

7 pages, 307 KB

Open AccessEditorial

Seeds Not Trophies: Reflections on a Scholarly Life of Publications

by Chee Kong Yap

Publications 2026, 14(1), 7; https://doi.org/10.3390/publications14010007 - 9 Jan 2026

Viewed by 228

Abstract

In 2003, as a young lecturer, I saw research as a craft to be learned, not a tally to be scored [...] Full article

► Show Figures

Figure 1

13 pages, 275 KB

Open AccessEssay

Reviewing Crowdsourcing and Community Engagement in Museums

by Paul Longley Arthur, Lydia Hearn and Isabel Smith

Publications 2026, 14(1), 6; https://doi.org/10.3390/publications14010006 - 5 Jan 2026

Viewed by 416

Abstract

Over the past two decades, museums have increasingly experimented with digital technologies to connect with broader contemporary culture. This review article investigates the role crowdsourcing can play in transforming museums into more engaged environments, raising visibility and inclusivity, and involving diverse voices and [...] Read more.

Over the past two decades, museums have increasingly experimented with digital technologies to connect with broader contemporary culture. This review article investigates the role crowdsourcing can play in transforming museums into more engaged environments, raising visibility and inclusivity, and involving diverse voices and populations in knowledge-creation processes. Its contribution is to provide an overview of the history, definitions and concepts of crowdsourcing, and examples of crowdsourcing policies and practices that have been adopted by museums. Participation in crowdsourcing has been influenced by gender, education, and socio-economic and cultural background. In the past, historical structures and traditions and infrastructural complexities have stood in the way of wider diversity and inclusivity. As museums move increasingly online, the circulation of information outside the museum’s walls is just as important as the specialist knowledge held within. Museums can play a leading role in public communication by reaching those who constitute the ‘crowd’. This paper explores how museums, through strong collaboration and various forms of crowdsourcing, such as citizen science and participatory engagement, can offer more wide-ranging open access for the sharing and democratisation of knowledge. Full article

32 pages, 2901 KB

Open AccessArticle

A Hybrid BWM-GRA-PROMETHEE Framework for Ranking Universities Based on Scientometric Indicators

by Dedy Kurniadi, Rahmat Gernowo and Bayu Surarso

Publications 2026, 14(1), 5; https://doi.org/10.3390/publications14010005 - 4 Jan 2026

Viewed by 447

Abstract

University rankings based on scientometric indicators frequently rely on compensatory aggregation models that allow extreme values to dominate the evaluation, while also remaining sensitive to outliers and unstable weighting procedures. These issues reduce the reliability and interpretability of the resulting rankings. This study [...] Read more.

University rankings based on scientometric indicators frequently rely on compensatory aggregation models that allow extreme values to dominate the evaluation, while also remaining sensitive to outliers and unstable weighting procedures. These issues reduce the reliability and interpretability of the resulting rankings. This study proposes a hybrid BWM–GRA–PROMETHEE (BGP) framework that combines judgement-based weighting Best-Worst Method (BWM), outlier-resistant normalization Grey Relational Analysis (GRA), and a non-compensatory outranking method Preference Ranking Organization Methods for Enrichment Evaluation (PROMETHEE II). The framework is applied to an expert-validated set of scientometric indicators to generate more stable and behaviorally grounded rankings. The results show that the proposed method maintains stability under weight and threshold variations and preserves ranking consistency even under outlier-contaminated scenarios. Comparative experiments further demonstrate that BGP is more robust than Additive Ratio Assesment (ARAS), Multi-Attributive Border Approximation Area Comparison (MABAC), and The Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS), achieving the highest Spearman. This study contributes a unified evaluation framework that jointly addresses three major methodological challenges in scientometric ranking, outlier sensitivity, compensatory effects, and instability from data-dependent weighting. By resolving these issues within a single integrated model, the proposed BGP approach offers a more reliable and methodologically rigorous foundation for researchers and policymakers seeking to evaluate and enhance research performance. Full article

► Show Figures

Figure 1

9 pages, 374 KB

Open AccessCommentary

The Newcastle–Ottawa Scale for Assessing the Quality of Studies in Systematic Reviews

by Emanuela Gualdi-Russo and Luciana Zaccagni

Publications 2026, 14(1), 4; https://doi.org/10.3390/publications14010004 - 1 Jan 2026

Cited by 3 | Viewed by 2994

Abstract

Secondary research is a cornerstone of health sciences, with substantial implications for clinical practice and health policy. Within the systematic review process, a key step is assessing study quality and risk of bias. Among the tools available for evaluating observational studies, the Newcastle–Ottawa [...] Read more.

Secondary research is a cornerstone of health sciences, with substantial implications for clinical practice and health policy. Within the systematic review process, a key step is assessing study quality and risk of bias. Among the tools available for evaluating observational studies, the Newcastle–Ottawa Scale (NOS) holds a prominent position and is widely applied in medical research. However, ambiguities and excessive subjectivity have been noted in its application. In this commentary, we discuss the Newcastle–Ottawa Scale guidelines, providing illustrative examples and practical recommendations for completing its items. Improving the accuracy of risk-of-bias assessment is crucial for enhancing the reliability of data synthesis and interpretation in the health sciences. Full article

► Show Figures

Figure A1

17 pages, 2690 KB

Open AccessArticle

Academic Libraries as Partners in Data Literacy Education—An Explorative Case Study

by Simone Fühles-Ubach, Elisabeth Kaliva and Martina Echtenbruck

Publications 2026, 14(1), 3; https://doi.org/10.3390/publications14010003 - 1 Jan 2026

Viewed by 430

Abstract

The concept of the ‘teaching library’, which originated in the Anglo-American world, describes all activities of libraries in the field of promoting information, media, and data literacy, as well as other skills in dealing with analog and digital media. Although data literacy is [...] Read more.

The concept of the ‘teaching library’, which originated in the Anglo-American world, describes all activities of libraries in the field of promoting information, media, and data literacy, as well as other skills in dealing with analog and digital media. Although data literacy is explicitly mentioned in this definition, many training courses in academic libraries seem to focus more on promoting library use, information, and media literacy. Given that the creation of data management plans, along with the indexing, storage, and reuse of research data, have become standard elements of the research process, this article discusses the growing importance of academic libraries in teaching data literacy. It presents a modular course framework, developed in exchange with the university library, as a reusable model for data literacy education. The primary objective is to introduce this framework and illustrate its application; preliminary, exploratory insights from a self-assessment survey are provided to support this presentation. The limited participant count in the pre- and post-evaluations restricts the statistical generalizability of the findings but provides a solid empirical impression of the effectiveness of the course format. Results indicate substantial learning progress in fields where academic libraries have proven expertise. The main conclusion is that such library-integrated interdisciplinary courses provide a valuable framework for data literacy education and highlight strategic areas for library involvement. Full article

(This article belongs to the Special Issue Academic Libraries in Supporting Research)

► Show Figures

Figure 1

16 pages, 604 KB

Open AccessArticle

Editorial Predictors of the Discontinuation of Open Access Scientific Journals in Scopus: An Analysis from DOAJ

by Jean Paul Simon Castillo-Nuñez, Carlos Alberto Minchon-Medina, Angie Clemente-Vega, Nohelia Rosa Vallenas-Aroni, Marile Lozano-Lozano and Myriam Báez-Sepúlveda

Publications 2026, 14(1), 2; https://doi.org/10.3390/publications14010002 - 1 Jan 2026

Viewed by 642

Abstract

Open access (OA) has expanded scholarly publishing, yet concerns remain about the sustainability of journals indexed in selective databases. This study analyzes editorial predictors of discontinuation among 8730 journals simultaneously registered in the Directory of Open Access Journals (DOAJ) and indexed in Scopus, [...] Read more.

Open access (OA) has expanded scholarly publishing, yet concerns remain about the sustainability of journals indexed in selective databases. This study analyzes editorial predictors of discontinuation among 8730 journals simultaneously registered in the Directory of Open Access Journals (DOAJ) and indexed in Scopus, including 58 (0.66%) discontinued titles as of June 2025 (latest available update at the time of data extraction). The analyses revealed that a journal’s history of prior discontinuation was the strongest and most consistent predictor of future instability, confirming that discontinuation follows a path-dependent pattern rather than isolated events. Financial structure also played a decisive role: journals applying other editorial fees beyond standard article processing charges (APCs) were nearly four times more likely to experience discontinuation (IRR = 3.877, p = 0.048), while those following standardized APC models showed a protective but non-significant tendency (IRR = 0.378, p = 0.084). Journal age exhibited a modest yet significant positive effect (IRR = 1.032, p = 0.031), suggesting that older titles face a gradual accumulation of risk over time. By contrast, editorial practices such as plagiarism detection, waiver policies, and turnaround time showed no significant association. Overall, the findings indicate that discontinuation in Scopus-indexed OA journals is statistically associated with historical trajectories, financial transparency, and governance capacity, rather than by routine editorial procedures. Full article

► Show Figures

Figure 1

29 pages, 3634 KB

Open AccessArticle

Human–AI Complementarity in Peer Review: Empirical Analysis of PeerJ Data and Design of an Efficient Collaborative Review Framework

by Zhihe Yang, Xiaoyu Zhou, Yuxin Jiang, Xinjie Zhang, Qihui Gao, Yanzhu Lu and Anqi Yang

Publications 2026, 14(1), 1; https://doi.org/10.3390/publications14010001 - 19 Dec 2025

Viewed by 1026

Abstract

In response to the persistent imbalance between the rapid expansion of scholarly publishing and the constrained availability of qualified reviewers, an empirical investigation was conducted to examine the feasibility and boundary conditions of employing Large Language Models (LLMs) in journal peer review. A [...] Read more.

In response to the persistent imbalance between the rapid expansion of scholarly publishing and the constrained availability of qualified reviewers, an empirical investigation was conducted to examine the feasibility and boundary conditions of employing Large Language Models (LLMs) in journal peer review. A parallel corpus of 493 pairs of human expert reviews and GPT-4o-generated reviews was constructed from the open peer-review platform PeerJ Computer Science. Analytical techniques, including keyword co-occurrence analysis, sentiment and subjectivity assessment, syntactic complexity measurement, and n-gram distributional entropy analysis, were applied to compare cognitive patterns, evaluative tendencies, and thematic coverage between human and AI reviewers. The results indicate that human and AI reviews exhibit complementary functional orientations. Human reviewers were observed to provide integrative and socially contextualized evaluations, while AI reviews emphasized structural verification and internal consistency, especially regarding the correspondence between abstracts and main texts. Contrary to the assumption of excessive leniency, GPT-4o-generated reviews demonstrated higher critical density and functional rigor, maintaining substantial topical alignment with human feedback. Based on these findings, a collaborative human–AI review framework is proposed, in which AI systems are positioned as analytical assistants that conduct structured verification prior to expert evaluation. Such integration is expected to enhance the efficiency, consistency, and transparency of the peer-review process and to promote the sustainable development of scholarly communication. Full article

(This article belongs to the Special Issue AI in Academic Metrics and Impact Analysis)

► Show Figures

Figure 1

Journal Menu

Journal Browser

Publications, Volume 14, Issue 1 (March 2026) – 9 articles

Further Information

Guidelines

MDPI Initiatives

Follow MDPI