Skip to Content

Machine Learning and Knowledge Extraction, Volume 5, Issue 4

2023 December - 33 articles

Cover Story: Unraveling the opacity of Deep Reinforcement Learning (DRL), our study delves into optimizing resource use. Contrary to the trend of increasing Experience Replay capacity, we intentionally reduce it, discovering a path to resource-efficient DRL. Across 20 Atari games and capacities from 1×106 to 1×102, we show that reducing capacity from 1×104 to 5×103 doesn't significantly impact rewards. To enhance interpretability, we visualize Experience Replay with the Deep SHAP Explainer, providing transparent explanations for agent decisions. Our findings advocate for a cautious reduction in Experience Replay, emphasizing interpretable decision explanations for efficient DRL. View this paper
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (33)

  • Article
  • Open Access
4,129 Views
26 Pages

11 December 2023

The overall purpose of this paper is to demonstrate how data preprocessing, training size variation, and subsampling can dynamically change the performance metrics of imbalanced text classification. The methodology encompasses using two different sup...

  • Article
  • Open Access
19 Citations
5,280 Views
16 Pages

11 December 2023

Epileptic seizures are a prevalent neurological condition that impacts a considerable portion of the global population. Timely and precise identification can result in as many as 70% of individuals achieving freedom from seizures. To achieve this, th...

  • Article
  • Open Access
7 Citations
2,909 Views
16 Pages

Social Intelligence Mining: Unlocking Insights from X

  • Hossein Hassani,
  • Nadejda Komendantova,
  • Elena Rovenskaya and
  • Mohammad Reza Yeganegi

11 December 2023

Social trend mining, situated at the confluence of data science and social research, provides a novel lens through which to examine societal dynamics and emerging trends. This paper explores the intricate landscape of social trend mining, with a spec...

  • Article
  • Open Access
4 Citations
2,625 Views
16 Pages

Generalized Permutants and Graph GENEOs

  • Faraz Ahmad,
  • Massimo Ferri and
  • Patrizio Frosini

9 December 2023

This paper is part of a line of research devoted to developing a compositional and geometric theory of Group Equivariant Non-Expansive Operators (GENEOs) for Geometric Deep Learning. It has two objectives. The first objective is to generalize the not...

  • Article
  • Open Access
2,807 Views
17 Pages

1 December 2023

Visual Reinforcement Learning (RL) has been largely investigated in recent decades. Existing approaches are often composed of multiple networks requiring massive computational power to solve partially observable tasks from high-dimensional data such...

  • Article
  • Open Access
5 Citations
3,430 Views
11 Pages

1 December 2023

A Bayesian network (BN) is a probabilistic graphical model that can model complex and nonlinear relationships. Its structural learning from data is an NP-hard problem because of its search-space size. One method to perform structural learning is a se...

  • Article
  • Open Access
2 Citations
2,286 Views
29 Pages

29 November 2023

The rapid development of semi-supervised machine learning (SSML) algorithms has shown enhanced versatility, but pinpointing the primary influencing factors remains a challenge. Historically, deep neural networks (DNNs) have been used to underpin thes...

  • Article
  • Open Access
7 Citations
4,495 Views
22 Pages

Android Malware Classification Based on Fuzzy Hashing Visualization

  • Horacio Rodriguez-Bazan,
  • Grigori Sidorov and
  • Ponciano Jorge Escamilla-Ambrosio

28 November 2023

The proliferation of Android-based devices has brought about an unprecedented surge in mobile application usage, making the Android ecosystem a prime target for cybercriminals. In this paper, a new method for Android malware classification is propose...

  • Article
  • Open Access
5 Citations
5,103 Views
30 Pages

Detecting Adversarial Examples Using Surrogate Models

  • Borna Feldsar,
  • Rudolf Mayer and
  • Andreas Rauber

27 November 2023

Deep Learning has enabled significant progress towards more accurate predictions and is increasingly integrated into our everyday lives in real-world applications; this is true especially for Convolutional Neural Networks (CNNs) in the field of image...

  • Article
  • Open Access
12 Citations
9,422 Views
36 Pages

Explainable Artificial Intelligence Using Expressive Boolean Formulas

  • Gili Rosenberg,
  • John Kyle Brubaker,
  • Martin J. A. Schuetz,
  • Grant Salton,
  • Zhihuai Zhu,
  • Elton Yechao Zhu,
  • Serdar Kadıoğlu,
  • Sima E. Borujeni and
  • Helmut G. Katzgraber

24 November 2023

We propose and implement an interpretable machine learning classification model for Explainable AI (XAI) based on expressive Boolean formulas. Potential applications include credit scoring and diagnosis of medical conditions. The Boolean formula defi...

  • Article
  • Open Access
2,743 Views
14 Pages

23 November 2023

In this paper, we present a comparative study of modern semantic segmentation loss functions and their resultant impact when applied with state-of-the-art off-road datasets. Class imbalance, inherent in these datasets, presents a significant challeng...

  • Article
  • Open Access
7 Citations
4,648 Views
29 Pages

Active Learning in the Detection of Anomalies in Cryptocurrency Transactions

  • Leandro L. Cunha,
  • Miguel A. Brito,
  • Domingos F. Oliveira and
  • Ana P. Martins

23 November 2023

The cryptocurrency market has grown significantly, and this quick growth has given rise to scams. It is necessary to put fraud detection mechanisms in place. The challenge of inadequate labeling is addressed in this work, which is a barrier to the tr...

  • Review
  • Open Access
2,070 Citations
131,504 Views
37 Pages

A Comprehensive Review of YOLO Architectures in Computer Vision: From YOLOv1 to YOLOv8 and YOLO-NAS

  • Juan Terven,
  • Diana-Margarita Córdova-Esparza and
  • Julio-Alejandro Romero-González

20 November 2023

YOLO has become a central real-time object detection system for robotics, driverless cars, and video monitoring applications. We present a comprehensive analysis of YOLO’s evolution, examining the innovations and contributions in each iteration...

  • Article
  • Open Access
12 Citations
8,324 Views
20 Pages

20 November 2023

In an era characterised by rapid technological advancement, the application of algorithmic approaches to address complex problems has become crucial across various disciplines. Within the realm of education, there is growing recognition of the pivota...

  • Systematic Review
  • Open Access
67 Citations
25,159 Views
48 Pages

Human Pose Estimation Using Deep Learning: A Systematic Literature Review

  • Esraa Samkari,
  • Muhammad Arif,
  • Manal Alghamdi and
  • Mohammed A. Al Ghamdi

13 November 2023

Human Pose Estimation (HPE) is the task that aims to predict the location of human joints from images and videos. This task is used in many applications, such as sports analysis and surveillance systems. Recently, several studies have embraced deep l...

  • Article
  • Open Access
17 Citations
4,953 Views
23 Pages

7 November 2023

The perception system is a safety-critical component that directly impacts the overall safety of autonomous driving systems (ADSs). It is imperative to ensure the robustness of the deep-learning model used in the perception system. However, studies h...

  • Article
  • Open Access
4 Citations
3,337 Views
19 Pages

Explainable Stacked Ensemble Deep Learning (SEDL) Framework to Determine Cause of Death from Verbal Autopsies

  • Michael T. Mapundu,
  • Chodziwadziwa W. Kabudula,
  • Eustasius Musenge,
  • Victor Olago and
  • Turgay Celik

25 October 2023

Verbal autopsies (VA) are commonly used in Low- and Medium-Income Countries (LMIC) to determine cause of death (CoD) where death occurs outside clinical settings, with the most commonly used international gold standard being physician medical certifi...

  • Article
  • Open Access
10 Citations
14,735 Views
13 Pages

Evaluating the Role of Machine Learning in Defense Applications and Industry

  • Evaldo Jorge Alcántara Suárez and
  • Victor Monzon Baeza

22 October 2023

Machine learning (ML) has become a critical technology in the defense sector, enabling the development of advanced systems for threat detection, decision making, and autonomous operations. However, the increasing ML use in defense systems has raised...

  • Article
  • Open Access
4,911 Views
18 Pages

21 October 2023

Implantable Cardiac Monitor (ICM) devices are demonstrating, as of today, the fastest-growing market for implantable cardiac devices. As such, they are becoming increasingly common in patients for measuring heart electrical activity. ICMs constantly...

  • Article
  • Open Access
7 Citations
3,766 Views
20 Pages

18 October 2023

The rise of machine-learning applications in domains with critical end-user impact has led to a growing concern about the fairness of learned models, with the goal of avoiding biases that negatively impact specific demographic groups. Most existing b...

  • Article
  • Open Access
8 Citations
4,822 Views
26 Pages

Deep Learning Techniques for Radar-Based Continuous Human Activity Recognition

  • Ruchita Mehta,
  • Sara Sharifzadeh,
  • Vasile Palade,
  • Bo Tan,
  • Alireza Daneshkhah and
  • Yordanka Karayaneva

14 October 2023

Human capability to perform routine tasks declines with age and age-related problems. Remote human activity recognition (HAR) is beneficial for regular monitoring of the elderly population. This paper addresses the problem of the continuous detection...

  • Article
  • Open Access
2,687 Views
19 Pages

Similarity-Based Framework for Unsupervised Domain Adaptation: Peer Reviewing Policy for Pseudo-Labeling

  • Joel Arweiler,
  • Cihan Ates,
  • Jesus Cerquides,
  • Rainer Koch and
  • Hans-Jörg Bauer

12 October 2023

The inherent dependency of deep learning models on labeled data is a well-known problem and one of the barriers that slows down the integration of such methods into different fields of applied sciences and engineering, in which experimental and numer...

  • Article
  • Open Access
2,958 Views
18 Pages

Mssgan: Enforcing Multiple Generators to Learn Multiple Subspaces to Avoid the Mode Collapse

  • Miguel S. Soriano-Garcia,
  • Ricardo Sevilla-Escoboza and
  • Angel Garcia-Pedrero

10 October 2023

Generative Adversarial Networks are powerful generative models that are used in different areas and with multiple applications. However, this type of model has a training problem called mode collapse. This problem causes the generator to not learn th...

  • Article
  • Open Access
7 Citations
5,049 Views
23 Pages

Reinforcement Learning (RL) has shown promise in optimizing complex control and decision-making processes but Deep Reinforcement Learning (DRL) lacks interpretability, limiting its adoption in regulated sectors like manufacturing, finance, and health...

  • Article
  • Open Access
5 Citations
6,314 Views
26 Pages

Machine Learning Method for Changepoint Detection in Short Time Series Data

  • Veronika Smejkalová,
  • Radovan Šomplák,
  • Martin Rosecký and
  • Kristína Šramková

Analysis of data is crucial in waste management to improve effective planning from both short- and long-term perspectives. Real-world data often presents anomalies, but in the waste management sector, anomaly detection is seldom performed. The main g...

  • Review
  • Open Access
26 Citations
7,437 Views
25 Pages

When Federated Learning Meets Watermarking: A Comprehensive Overview of Techniques for Intellectual Property Protection

  • Mohammed Lansari,
  • Reda Bellafqira,
  • Katarzyna Kapusta,
  • Vincent Thouvenot,
  • Olivier Bettan and
  • Gouenou Coatrieux

Federated learning (FL) is a technique that allows multiple participants to collaboratively train a Deep Neural Network (DNN) without the need to centralize their data. Among other advantages, it comes with privacy-preserving properties, making it at...

  • Article
  • Open Access
2 Citations
4,338 Views
23 Pages

This paper addresses the problem of learning temporal graph representations, which capture the changing nature of complex evolving networks. Existing approaches mainly focus on adding new nodes and edges to capture dynamic graph structures. However,...

  • Article
  • Open Access
25 Citations
8,157 Views
19 Pages

Predicting the Long-Term Dependencies in Time Series Using Recurrent Artificial Neural Networks

  • Cristian Ubal,
  • Gustavo Di-Giorgi,
  • Javier E. Contreras-Reyes and
  • Rodrigo Salas

Long-term dependence is an essential feature for the predictability of time series. Estimating the parameter that describes long memory is essential to describing the behavior of time series models. However, most long memory estimation methods assume...

  • Article
  • Open Access
6 Citations
5,342 Views
20 Pages

29 September 2023

This study introduces an optimal topology of vision transformers for real-time video action recognition in a cloud-based solution. Although model performance is a key criterion for real-time video analysis use cases, inference latency plays a more cr...

  • Article
  • Open Access
1 Citations
2,642 Views
18 Pages

PCa-Clf: A Classifier of Prostate Cancer Patients into Patients with Indolent and Aggressive Tumors Using Machine Learning

  • Yashwanth Karthik Kumar Mamidi,
  • Tarun Karthik Kumar Mamidi,
  • Md Wasi Ul Kabir,
  • Jiande Wu,
  • Md Tamjidul Hoque and
  • Chindo Hicks

27 September 2023

A critical unmet medical need in prostate cancer (PCa) clinical management centers around distinguishing indolent from aggressive tumors. Traditionally, Gleason grading has been utilized for this purpose. However, tumor classification using Gleason G...

  • Article
  • Open Access
20 Citations
6,332 Views
20 Pages

25 September 2023

A modification of the brainstorming process by the application of artificial intelligence (AI) was proposed. Here, we describe the design of the software system “kresilnik”, which enables hybrid work between a human group and AI. The prop...

  • Article
  • Open Access
7 Citations
3,556 Views
16 Pages

Unraveling COVID-19 Dynamics via Machine Learning and XAI: Investigating Variant Influence and Prognostic Classification

  • Oliver Lohaj,
  • Ján Paralič,
  • Peter Bednár,
  • Zuzana Paraličová and
  • Matúš Huba

25 September 2023

Machine learning (ML) has been used in different ways in the fight against COVID-19 disease. ML models have been developed, e.g., for diagnostic or prognostic purposes and using various modalities of data (e.g., textual, visual, or structured). Due t...

  • Article
  • Open Access
4 Citations
3,938 Views
32 Pages

Beyond Weisfeiler–Lehman with Local Ego-Network Encodings

  • Nurudin Alvarez-Gonzalez,
  • Andreas Kaltenbrunner and
  • Vicenç Gómez

22 September 2023

Identifying similar network structures is key to capturing graph isomorphisms and learning representations that exploit structural information encoded in graph data. This work shows that ego networks can produce a structural encoding scheme for arbit...

XFacebookLinkedIn
Mach. Learn. Knowl. Extr. - ISSN 2504-4990