Skip Content
You are currently on the new version of our website. Access the old version .

Most Cited

  • Article
  • Open Access
161 Citations
11,902 Views
22 Pages

Diffusion Probabilistic Modeling for Video Generation

  • Ruihan Yang,
  • Prakhar Srivastava and
  • Stephan Mandt

20 October 2023

Denoising diffusion probabilistic models are a promising new class of generative models that mark a milestone in high-quality image generation. This paper showcases their ability to sequentially generate video, surpassing prior methods in perceptual...

  • Review
  • Open Access
102 Citations
21,054 Views
23 Pages

Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Review

  • Man-Fai Wong,
  • Shangxin Guo,
  • Ching-Nam Hang,
  • Siu-Wai Ho and
  • Chee-Wei Tan

1 June 2023

This paper provides a comprehensive review of the literature concerning the utilization of Natural Language Processing (NLP) techniques, with a particular focus on transformer-based large language models (LLMs) trained using Big Code, within the doma...

  • Review
  • Open Access
87 Citations
36,160 Views
33 Pages

A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face

  • Hailun Lian,
  • Cheng Lu,
  • Sunan Li,
  • Yan Zhao,
  • Chuangao Tang and
  • Yuan Zong

12 October 2023

Multimodal emotion recognition (MER) refers to the identification and understanding of human emotional states by combining different signals, including—but not limited to—text, speech, and face cues. MER plays a crucial role in the human&...

  • Article
  • Open Access
77 Citations
11,586 Views
20 Pages

Water Quality Prediction Based on Machine Learning and Comprehensive Weighting Methods

  • Xianhe Wang,
  • Ying Li,
  • Qian Qiao,
  • Adriano Tavares and
  • Yanchun Liang

9 August 2023

In the context of escalating global environmental concerns, the importance of preserving water resources and upholding ecological equilibrium has become increasingly apparent. As a result, the monitoring and prediction of water quality have emerged a...

  • Article
  • Open Access
75 Citations
3,145 Views
23 Pages

Exploiting Dynamic Vector-Level Operations and a 2D-Enhanced Logistic Modular Map for Efficient Chaotic Image Encryption

  • Hongmin Li,
  • Shuqi Yu,
  • Wei Feng,
  • Yao Chen,
  • Jing Zhang,
  • Zhentao Qin,
  • Zhengguo Zhu and
  • Marcin Wozniak

31 July 2023

Over the past few years, chaotic image encryption has gained extensive attention. Nevertheless, the current studies on chaotic image encryption still possess certain constraints. To break these constraints, we initially created a two-dimensional enha...

  • Review
  • Open Access
67 Citations
19,112 Views
28 Pages

12 March 2024

Deep neural networks excel in supervised learning tasks but are constrained by the need for extensive labeled data. Self-supervised learning emerges as a promising alternative, allowing models to learn without explicit labels. Information theory has...

  • Opinion
  • Open Access
66 Citations
18,730 Views
24 Pages

9 October 2023

Recent advancements in artificial intelligence (AI) technology have raised concerns about the ethical, moral, and legal safeguards. There is a pressing need to improve metrics for assessing security and privacy of AI systems and to manage AI technolo...

  • Article
  • Open Access
56 Citations
6,060 Views
35 Pages

Security-Informed Safety Analysis of Autonomous Transport Systems Considering AI-Powered Cyberattacks and Protection

  • Oleg Illiashenko,
  • Vyacheslav Kharchenko,
  • Ievgen Babeshko,
  • Herman Fesenko and
  • Felicita Di Giandomenico

26 July 2023

The entropy-oriented approach called security- or cybersecurity-informed safety (SIS or CSIS, respectively) is discussed and developed in order to analyse and evaluate the safety and dependability of autonomous transport systems (ATSs) such as unmann...

  • Article
  • Open Access
56 Citations
6,067 Views
22 Pages

Modeling and Optimization of Hydraulic and Thermal Performance of a Tesla Valve Using a Numerical Method and Artificial Neural Network

  • Kourosh Vaferi,
  • Mohammad Vajdi,
  • Amir Shadian,
  • Hamed Ahadnejad,
  • Farhad Sadegh Moghanlou,
  • Hossein Nami and
  • Haleh Jafarzadeh

22 June 2023

The Tesla valve is a non-moving check valve used in various industries to control fluid flow. It is a passive flow control device that does not require external power to operate. Due to its unique geometry, it causes more pressure drop in the reverse...

  • Feature Paper
  • Review
  • Open Access
56 Citations
7,365 Views
85 Pages

Theories of Relativistic Dissipative Fluid Dynamics

  • Gabriel S. Rocha,
  • David Wagner,
  • Gabriel S. Denicol,
  • Jorge Noronha and
  • Dirk H. Rischke

22 February 2024

Relativistic dissipative fluid dynamics finds widespread applications in high-energy nuclear physics and astrophysics. However, formulating a causal and stable theory of relativistic dissipative fluid dynamics is far from trivial; efforts to accompli...

  • Review
  • Open Access
52 Citations
16,880 Views
26 Pages

Theory and Application of Zero Trust Security: A Brief Survey

  • Hongzhaoning Kang,
  • Gang Liu,
  • Quan Wang,
  • Lei Meng and
  • Jing Liu

28 November 2023

As cross-border access becomes more frequent, traditional perimeter-based network security models can no longer cope with evolving security requirements. Zero trust is a novel paradigm for cybersecurity based on the core concept of “never trust...

  • Article
  • Open Access
46 Citations
5,882 Views
23 Pages

19 March 2023

Support vector machine (SVM) is a widely used and effective classifier. Its efficiency and accuracy mainly depend on the exceptional feature subset and optimal parameters. In this paper, a new feature selection method and an improved particle swarm o...

  • Article
  • Open Access
45 Citations
6,119 Views
14 Pages

A Pedestrian Detection Network Model Based on Improved YOLOv5

  • Ming-Lun Li,
  • Guo-Bing Sun and
  • Jia-Xiang Yu

19 February 2023

Advanced object detection methods always face high algorithmic complexity or low accuracy when used in pedestrian target detection for the autonomous driving system. This paper proposes a lightweight pedestrian detection approach called the YOLOv5s-G...

  • Article
  • Open Access
42 Citations
9,427 Views
32 Pages

Benign and Malignant Breast Tumor Classification in Ultrasound and Mammography Images via Fusion of Deep Learning and Handcraft Features

  • Clara Cruz-Ramos,
  • Oscar García-Avila,
  • Jose-Agustin Almaraz-Damian,
  • Volodymyr Ponomaryov,
  • Rogelio Reyes-Reyes and
  • Sergiy Sadovnychiy

28 June 2023

Breast cancer is a disease that affects women in different countries around the world. The real cause of breast cancer is particularly challenging to determine, and early detection of the disease is necessary for reducing the death rate, due to the h...

  • Review
  • Open Access
42 Citations
6,584 Views
14 Pages

Fuzzy C-Means Clustering: A Review of Applications in Breast Cancer Detection

  • Daniel Krasnov,
  • Dresya Davis,
  • Keiran Malott,
  • Yiting Chen,
  • Xiaoping Shi and
  • Augustine Wong

4 July 2023

This paper reviews the potential use of fuzzy c-means clustering (FCM) and explores modifications to the distance function and centroid initialization methods to enhance image segmentation. The application of interest in the paper is the segmentation...

  • Feature Paper
  • Article
  • Open Access
41 Citations
5,574 Views
16 Pages

Correlations of Cross-Entropy Loss in Machine Learning

  • Richard Connor,
  • Alan Dearle,
  • Ben Claydon and
  • Lucia Vadicamo

3 June 2024

Cross-entropy loss is crucial in training many deep neural networks. In this context, we show a number of novel and strong correlations among various related divergence functions. In particular, we demonstrate that, in some circumstances, (a) cross-e...

  • Article
  • Open Access
40 Citations
2,460 Views
18 Pages

Spectrum Sensing Based on Hybrid Spectrum Handoff in Cognitive Radio Networks

  • Lakshminarayanan Vaduganathan,
  • Shubhangi Neware,
  • Przemysław Falkowski-Gilski and
  • Parameshachari Bidare Divakarachari

31 August 2023

The rapid advancement of wireless communication combined with insufficient spectrum exploitation opens the door for the expansion of novel wireless services. Cognitive radio network (CRN) technology makes it possible to periodically access the open s...

  • Article
  • Open Access
39 Citations
2,535 Views
13 Pages

Feedback Control of Quantum Correlations in a Cavity Magnomechanical System with Magnon Squeezing

  • Mohamed Amazioug,
  • Shailendra Singh,
  • Berihu Teklu and
  • Muhammad Asjad

18 October 2023

We suggest a method to improve quantum correlations in cavity magnomechanics, through the use of a coherent feedback loop and magnon squeezing. The entanglement of three bipartition subsystems: photon-phonon, photon-magnon, and phonon-magnon, is sign...

  • Article
  • Open Access
39 Citations
6,279 Views
20 Pages

PLDP-FL: Federated Learning with Personalized Local Differential Privacy

  • Xiaoying Shen,
  • Hang Jiang,
  • Yange Chen,
  • Baocang Wang and
  • Le Gao

10 March 2023

As a popular machine learning method, federated learning (FL) can effectively solve the issues of data silos and data privacy. However, traditional federated learning schemes cannot provide sufficient privacy protection. Furthermore, most secure fede...

  • Article
  • Open Access
39 Citations
12,573 Views
16 Pages

Cryptocurrencies Are Becoming Part of the World Global Financial Market

  • Marcin Wątorek,
  • Jarosław Kwapień and
  • Stanisław Drożdż

18 February 2023

In this study the cross-correlations between the cryptocurrency market represented by the two most liquid and highest-capitalized cryptocurrencies: bitcoin and ethereum, on the one side, and the instruments representing the traditional financial mark...

  • Article
  • Open Access
38 Citations
3,729 Views
10 Pages

Fractal Derivatives, Fractional Derivatives and q-Deformed Calculus

  • Airton Deppman,
  • Eugenio Megías and
  • Roman Pasechnik

30 June 2023

This work presents an analysis of fractional derivatives and fractal derivatives, discussing their differences and similarities. The fractal derivative is closely connected to Haussdorff’s concepts of fractional dimension geometry. The paper di...

  • Article
  • Open Access
38 Citations
2,975 Views
30 Pages

A Rolling Bearing Fault Diagnosis Method Based on the WOA-VMD and the GAT

  • Yaping Wang,
  • Sheng Zhang,
  • Ruofan Cao,
  • Di Xu and
  • Yuqi Fan

1 June 2023

In complex industrial environments, the vibration signal of the rolling bearing is covered by noise, which makes fault diagnosis inaccurate. In order to overcome the effect of noise on the signal, a rolling bearing fault diagnosis method based on the...

  • Article
  • Open Access
37 Citations
2,238 Views
17 Pages

8 May 2024

As one of the most vital energy conversation systems, the safe operation of wind turbines is very important; however, weak fault and time-varying speed may challenge the conventional monitoring strategies. Thus, an entropy-aided meshing-order modulat...

  • Review
  • Open Access
36 Citations
13,082 Views
35 Pages

A Survey on Deep Learning Based Segmentation, Detection and Classification for 3D Point Clouds

  • Prasoon Kumar Vinodkumar,
  • Dogus Karabulut,
  • Egils Avots,
  • Cagri Ozcinar and
  • Gholamreza Anbarjafari

10 April 2023

The computer vision, graphics, and machine learning research groups have given a significant amount of focus to 3D object recognition (segmentation, detection, and classification). Deep learning approaches have lately emerged as the preferred method...

  • Article
  • Open Access
36 Citations
4,521 Views
19 Pages

Dual-ATME: Dual-Branch Attention Network for Micro-Expression Recognition

  • Haoliang Zhou,
  • Shucheng Huang,
  • Jingting Li and
  • Su-Jing Wang

6 March 2023

Micro-expression recognition (MER) is challenging due to the difficulty of capturing the instantaneous and subtle motion changes of micro-expressions (MEs). Early works based on hand-crafted features extracted from prior knowledge showed some promisi...

  • Review
  • Open Access
35 Citations
12,885 Views
36 Pages

10 February 2023

The reinforcement learning (RL) research area is very active, with an important number of new contributions, especially considering the emergent field of deep RL (DRL). However, a number of scientific and technical challenges still need to be resolve...

  • Article
  • Open Access
35 Citations
1,942 Views
19 Pages

Social Image Security with Encryption and Watermarking in Hybrid Domains

  • Conghuan Ye,
  • Shenglong Tan,
  • Jun Wang,
  • Li Shi,
  • Qiankun Zuo and
  • Wei Feng

6 March 2025

In this digital era, social images are the most vital information carrier on multimedia social platforms. More and more users are interested in sharing social images with mobile terminals on multimedia social platforms. Social image sharing also face...

  • Feature Paper
  • Article
  • Open Access
34 Citations
5,321 Views
10 Pages

Entanglement Witness for the Weak Equivalence Principle

  • Sougato Bose,
  • Anupam Mazumdar,
  • Martine Schut and
  • Marko Toroš

3 March 2023

The Einstein equivalence principle is based on the equality of gravitational and inertial mass, which has led to the universality of a free-fall concept. The principle has been extremely well tested so far and has been tested with a great precision....

  • Feature Paper
  • Article
  • Open Access
33 Citations
5,538 Views
19 Pages

26 April 2024

Determining criteria weights plays a crucial role in multi-criteria decision analyses. Entropy is a significant measure in information science, and several multi-criteria decision-making methods utilize the entropy weight method (EWM). In the literat...

  • Feature Paper
  • Article
  • Open Access
31 Citations
6,979 Views
22 Pages

A Joint Communication and Computation Design for Probabilistic Semantic Communications

  • Zhouxiang Zhao,
  • Zhaohui Yang,
  • Mingzhe Chen,
  • Zhaoyang Zhang and
  • H. Vincent Poor

30 April 2024

In this paper, the problem of joint transmission and computation resource allocation for a multi-user probabilistic semantic communication (PSC) network is investigated. In the considered model, users employ semantic information extraction techniques...

  • Article
  • Open Access
31 Citations
2,654 Views
14 Pages

Lossy Micromaser Battery: Almost Pure States in the Jaynes–Cummings Regime

  • Vahid Shaghaghi,
  • Varinder Singh,
  • Matteo Carrega,
  • Dario Rosa and
  • Giuliano Benenti

27 February 2023

We consider a micromaser model of a quantum battery, where the battery is a single mode of the electromagnetic field in a cavity, charged via repeated interactions with a stream of qubits, all prepared in the same non-equilibrium state, either incohe...

  • Review
  • Open Access
30 Citations
15,784 Views
29 Pages

Semantic Communication: A Survey of Its Theoretical Development

  • Gangtao Xin,
  • Pingyi Fan and
  • Khaled B. Letaief

24 January 2024

In recent years, semantic communication has received significant attention from both academia and industry, driven by the growing demands for ultra-low latency and high-throughput capabilities in emerging intelligent services. Nonetheless, a comprehe...

  • Article
  • Open Access
29 Citations
5,724 Views
15 Pages

Distance Correlation-Based Feature Selection in Random Forest

  • Suthakaran Ratnasingam and
  • Jose Muñoz-Lopez

23 August 2023

The Pearson correlation coefficient (ρ) is a commonly used measure of correlation, but it has limitations as it only measures the linear relationship between two numerical variables. The distance correlation measures all types of dependencies bet...

  • Feature Paper
  • Article
  • Open Access
28 Citations
6,462 Views
15 Pages

29 April 2024

Uncovering the mechanisms behind long-term memory is one of the most fascinating open problems in neuroscience and artificial intelligence. Artificial associative memory networks have been used to formalize important aspects of biological memory. Gen...

  • Article
  • Open Access
28 Citations
3,099 Views
26 Pages

Refined Composite Multiscale Fuzzy Dispersion Entropy and Its Applications to Bearing Fault Diagnosis

  • Mostafa Rostaghi,
  • Mohammad Mahdi Khatibi,
  • Mohammad Reza Ashory and
  • Hamed Azami

29 October 2023

Rotary machines often exhibit nonlinear behavior due to factors such as nonlinear stiffness, damping, friction, coupling effects, and defects. Consequently, their vibration signals display nonlinear characteristics. Entropy techniques prove to be eff...

  • Article
  • Open Access
27 Citations
2,870 Views
20 Pages

22 February 2024

Dissolved gas analysis (DGA) in transformer oil, which analyzes its gas content, is valuable for promptly detecting potential faults in oil-immersed transformers. Given the limitations of traditional transformer fault diagnostic methods, such as insu...

  • Article
  • Open Access
27 Citations
3,000 Views
18 Pages

1 February 2024

Insulator defect detection of transmission line insulators is an important task for unmanned aerial vehicle (UAV) inspection, which is of immense importance in ensuring the stable operation of transmission lines. Transmission line insulators exist in...

  • Article
  • Open Access
27 Citations
6,936 Views
15 Pages

Entanglement Swapping and Swapped Entanglement

  • Sultan M. Zangi,
  • Chitra Shukla,
  • Atta ur Rahman and
  • Bo Zheng

25 February 2023

Entanglement swapping is gaining widespread attention due to its application in entanglement distribution among different parts of quantum appliances. We investigate the entanglement swapping for pure and noisy systems, and argue different entangleme...

  • Article
  • Open Access
26 Citations
6,418 Views
18 Pages

Delegated Proof of Stake Consensus Mechanism Based on Community Discovery and Credit Incentive

  • Wangchun Li,
  • Xiaohong Deng,
  • Juan Liu,
  • Zhiwei Yu and
  • Xiaoping Lou

10 September 2023

Consensus algorithms are the core technology of a blockchain and directly affect the implementation and application of blockchain systems. Delegated proof of stake (DPoS) significantly reduces the time required for transaction verification by selecti...

  • Review
  • Open Access
26 Citations
21,440 Views
56 Pages

Emergence and Causality in Complex Systems: A Survey of Causal Emergence and Related Quantitative Studies

  • Bing Yuan,
  • Jiang Zhang,
  • Aobo Lyu,
  • Jiayun Wu,
  • Zhipeng Wang,
  • Mingzhe Yang,
  • Kaiwei Liu,
  • Muyun Mou and
  • Peng Cui

24 January 2024

Emergence and causality are two fundamental concepts for understanding complex systems. They are interconnected. On one hand, emergence refers to the phenomenon where macroscopic properties cannot be solely attributed to the cause of individual prope...

  • Feature Paper
  • Article
  • Open Access
26 Citations
3,537 Views
17 Pages

11 March 2025

Generative diffusion models have achieved spectacular performance in many areas of machine learning and generative modeling. While the fundamental ideas behind these models come from non-equilibrium physics, variational inference, and stochastic calc...

  • Article
  • Open Access
25 Citations
3,634 Views
20 Pages

Dynamical Quantum Phase Transitions of the Schwinger Model: Real-Time Dynamics on IBM Quantum

  • Domenico Pomarico,
  • Leonardo Cosmai,
  • Paolo Facchi,
  • Cosmo Lupo,
  • Saverio Pascazio and
  • Francesco V. Pepe

3 April 2023

Simulating the real-time dynamics of gauge theories represents a paradigmatic use case to test the hardware capabilities of a quantum computer, since it can involve non-trivial input states’ preparation, discretized time evolution, long-distanc...

  • Article
  • Open Access
25 Citations
3,867 Views
24 Pages

Detection of Pilot’s Mental Workload Using a Wireless EEG Headset in Airfield Traffic Pattern Tasks

  • Chenglin Liu,
  • Chenyang Zhang,
  • Luohao Sun,
  • Kun Liu,
  • Haiyue Liu,
  • Wenbing Zhu and
  • Chaozhe Jiang

10 July 2023

Elevated mental workload (MWL) experienced by pilots can result in increased reaction times or incorrect actions, potentially compromising flight safety. This study aims to develop a functional system to assist administrators in identifying and detec...

  • Article
  • Open Access
25 Citations
4,386 Views
16 Pages

29 May 2023

In order to increase the security and robustness of quantum images, this study combined the quantum DNA codec with quantum Hilbert scrambling to offer an enhanced quantum image encryption technique. Initially, to accomplish pixel-level diffusion and...

  • Article
  • Open Access
25 Citations
5,332 Views
21 Pages

Comparative Study of Variations in Quantum Approximate Optimization Algorithms for the Traveling Salesman Problem

  • Wenyang Qian,
  • Robert A. M. Basili,
  • Mary Mehrnoosh Eshaghian-Wilner,
  • Ashfaq Khokhar,
  • Glenn Luecke and
  • James P. Vary

21 August 2023

The traveling salesman problem (TSP) is one of the most often-used NP-hard problems in computer science to study the effectiveness of computing models and hardware platforms. In this regard, it is also heavily used as a vehicle to study the feasibili...

  • Feature Paper
  • Article
  • Open Access
25 Citations
6,146 Views
21 Pages

30 December 2023

We introduce Brain-Inspired Modular Training (BIMT), a method for making neural networks more modular and interpretable. Inspired by brains, BIMT embeds neurons in a geometric space and augments the loss function with a cost proportional to the lengt...

  • Article
  • Open Access
24 Citations
7,284 Views
19 Pages

20 April 2023

Noisy Intermediate-Scale Quantum (NISQ) systems and associated programming interfaces make it possible to explore and investigate the design and development of quantum computing techniques for Machine Learning (ML) applications. Among the most recent...

  • Article
  • Open Access
24 Citations
7,411 Views
30 Pages

How Much Is Enough? A Study on Diffusion Times in Score-Based Generative Models

  • Giulio Franzese,
  • Simone Rossi,
  • Lixuan Yang,
  • Alessandro Finamore,
  • Dario Rossi,
  • Maurizio Filippone and
  • Pietro Michiardi

7 April 2023

Score-based diffusion models are a class of generative models whose dynamics is described by stochastic differential equations that map noise into data. While recent works have started to lay down a theoretical foundation for these models, a detailed...

  • Article
  • Open Access
24 Citations
3,346 Views
17 Pages

4 March 2023

Proxy signature is one of the important primitives of public-key cryptography and plays an essential role in delivering security services in modern communications. However, existing post quantum proxy signature schemes with larger signature sizes mig...

Get Alerted

Add your email address to receive forthcoming issues of this journal.

XFacebookLinkedIn
Entropy - ISSN 1099-4300