Skip to Content

2,325 Results Found

  • Article
  • Open Access
23 Citations
2,733 Views
42 Pages

12 October 2022

We explore an exchangeably weighted bootstrap of the general function-indexed empirical U-processes in the Markov setting, which is a natural higher-order generalization of the weighted bootstrap empirical processes. As a result of our findings, a co...

(This article belongs to the Special Issue Current Developments in Theoretical and Applied Statistics)
  • Article
  • Open Access
1 Citations
3,810 Views
16 Pages

30 August 2020

In a general Markov decision progress system, only one agent’s learning evolution is considered. However, considering the learning evolution of a single agent in many problems has some limitations, more and more applications involve multi-agent...

(This article belongs to the Special Issue Probabilistic Inference in Goal-Directed Human and Animal Decision-Making)
  • Feature Paper
  • Article
  • Open Access
2 Citations
4,230 Views
14 Pages

The goal of this research is to maximize chord-based composition possibilities given a relatively small amount of information. A transformational approach, based in group theory, was chosen, focusing on chord intervals as the components of a modified...

(This article belongs to the Section Natural Sciences)
  • Article
  • Open Access
14 Citations
2,368 Views
16 Pages

18 December 2023

Generally, these days people live longer but often with increased impairment and disabilities; therefore, they can benefit from assistive technologies. In this paper, we focus on the completion of activities of daily living (ADLs) by such patients, u...

(This article belongs to the Special Issue Stochastic Processes and Their Applications: In Honor of Prof. Sally McClean)
  • Article
  • Open Access
43 Citations
6,708 Views
15 Pages

7 October 2019

The performance of urban bridges will deteriorate gradually throughout service life. Bridge deterioration prediction is essential for bridge management, especially for maintenance planning and decision-making. By considering the time-dependent reliab...

(This article belongs to the Special Issue Sustainable Construction Engineering and Management)
  • Article
  • Open Access
6 Citations
3,567 Views
12 Pages

A Markov Decision Process with Awareness and Present Bias in Decision-Making

  • Federico Bizzarri,
  • Chiara Mocenni and
  • Silvia Tiezzi

5 June 2023

We propose a Markov Decision Process Model that blends ideas from Psychological research and Economics to study decision-making in individuals with self-control problems. We have borrowed a dual-process of decision-making with self-awareness from Psy...

(This article belongs to the Special Issue Recent Advances in Mathematical Methods for Economics)
  • Article
  • Open Access
1 Citations
1,048 Views
16 Pages

27 September 2025

This article investigates the zonotope-based state estimation for boost converter system with Markov jump process. DC-DC boost converters are pivotal in modern power electronics, enabling renewable energy integration, electric vehicle charging, and m...

(This article belongs to the Topic New Developments for Circuit Design: Synthesis, Modeling, Simulation, and Applications)
  • Article
  • Open Access
14 Citations
6,834 Views
17 Pages

Mathematical Modeling of Manufacturing Lines with Distribution by Process: A Markov Chain Approach

  • Gilberto Pérez-Lechuga,
  • Francisco Venegas-Martínez and
  • José Francisco Martínez-Sánchez

16 December 2021

Today, there are a wide variety of ways to produce goods in a manufacturing company. Among the most common are mass or line production and process production, both of which are antagonists. In an online production system, materials move from station...

(This article belongs to the Special Issue Recent Advances in Business and Industry: Mathematical Analysis, Sustainability Assessment Instruments and Methods)
  • Article
  • Open Access
5 Citations
4,078 Views
12 Pages

17 April 2020

A Bayesian approach was developed, tested, and applied to model ordinal response data in monotone non-decreasing processes with measurement errors. An inhomogeneous hidden Markov model with continuous state-space was considered to incorporate measure...

(This article belongs to the Special Issue Statistics 2020)
  • Feature Paper
  • Article
  • Open Access
4 Citations
3,771 Views
24 Pages

5 March 2023

The mixture of Gaussian process functional regressions (GPFRs) assumes that there is a batch of time series or sample curves that are generated by independent random processes with different temporal structures. However, in real situations, these str...

(This article belongs to the Special Issue Interpretable Models and Their Applications in Neural Computation and Statistical Learning)
  • Article
  • Open Access
17 Citations
5,155 Views
16 Pages

China imports a large quantity of bauxite each year. Bauxite in fine particles with high moisture has a high risk of liquefaction during the maritime transportation process, which is harmful to the stability and safety of the carrier. To ensure safe...

(This article belongs to the Special Issue Advances in Marine Dynamic Simulation)
  • Article
  • Open Access
18 Citations
4,794 Views
13 Pages

26 December 2022

Maintenance decision-making is essential to achieve safe and reliable operation with high performance for equipment. To avoid unexpected shutdown and increase machine life as well as system efficiency, it is fundamental to design an effective mainten...

(This article belongs to the Special Issue Data Mining and Machine Learning with Applications)
  • Article
  • Open Access
11 Citations
5,955 Views
15 Pages

12 January 2023

Corrosion is one of the major causes of failure in pipelines for transporting oil and gas products. To mitigate the impact of this problem, organizations perform different maintenance operations, including detecting corrosion, determining corrosion g...

(This article belongs to the Section Analysis of Algorithms and Complexity Theory)
  • Article
  • Open Access
3 Citations
4,973 Views
33 Pages

Process Mining IPTV Customer Eye Gaze Movement Using Discrete-Time Markov Chains

  • Zhi Chen,
  • Shuai Zhang,
  • Sally McClean,
  • Fionnuala Hart,
  • Michael Milliken,
  • Brahim Allan and
  • Ian Kegel

2 February 2023

Human-Computer Interaction (HCI) research has extensively employed eye-tracking technologies in a variety of fields. Meanwhile, the ongoing development of Internet Protocol TV (IPTV) has significantly enriched the TV customer experience, which is of...

(This article belongs to the Special Issue Process Mining and Its Applications)
  • Article
  • Open Access
3 Citations
3,090 Views
13 Pages

5 May 2023

LEO satellite mega-constellation projects have been proposed by many countries or commercial organizations in recent years. With more than 2000 satellites launched by SpaceX to configure the Starlink system, the orbital resources are more constrained...

(This article belongs to the Section F: Engineering and Materials)
  • Article
  • Open Access
6 Citations
9,907 Views
15 Pages

Safe Reinforcement Learning for Arm Manipulation with Constrained Markov Decision Process

  • Patrick Adjei,
  • Norman Tasfi,
  • Santiago Gomez-Rosero and
  • Miriam A. M. Capretz

18 April 2024

In the world of human–robot coexistence, ensuring safe interactions is crucial. Traditional logic-based methods often lack the intuition required for robots, particularly in complex environments where these methods fail to account for all possi...

(This article belongs to the Section AI in Robotics)
  • Article
  • Open Access
21 Citations
3,025 Views
15 Pages

29 September 2024

A remarkably high growth has been observed in the uses of wireless sensor networks (WSNs), due to their momentous potential in various applications, namely the health sector, smart agriculture, safety systems, environmental monitoring, military opera...

(This article belongs to the Special Issue Graph Theory and Network Theory)
  • Article
  • Open Access
8 Citations
3,318 Views
19 Pages

14 April 2022

In the context of distributed defense, multi-sensor networks are required to be able to carry out reasonable planning and scheduling to achieve the purpose of continuous, accurate and rapid target detection. In this paper, a multi-sensor cooperative...

(This article belongs to the Topic Wireless Sensor Networks)
  • Article
  • Open Access
3 Citations
3,059 Views
17 Pages

20 March 2024

Federated Learning (FL), as an emerging paradigm in distributed machine learning, has received extensive research attention. However, few works consider the impact of device mobility on the learning efficiency of FL. In fact, it is detrimental to the...

(This article belongs to the Special Issue Advances in Mobile Network and Intelligent Communication)
  • Article
  • Open Access
22 Citations
4,196 Views
13 Pages

19 December 2023

The Analytic Hierarchy Process (AHP) has been a widely used multi-criteria decision-making (MCDM) method since the 1980s because of its simplicity and rationality. However, the conventional AHP assumes criteria independence, which is not always accur...

  • Article
  • Open Access
445 Views
33 Pages

Emergency Load-Shedding Decision for Frequency Stability of New Energy Power System Based on Constrained Markov Decision Process

  • Qiushi Fang,
  • Zhentao Han,
  • Wenhui He,
  • Yufei Jin,
  • Zewei Li,
  • Mingxuan Lu,
  • Weihan Chen,
  • Jiawen Gao and
  • Rui Zhang

26 June 2026

Renewable energy systems dominated by powered electronic devices generally exhibit weak disturbance tolerance and limited grid-support capability. Following the blocking of a flexible DC transmission system, emergency load shedding in renewable-rich...

(This article belongs to the Special Issue Application of Artificial Intelligence in Electrical Power Systems)
  • Article
  • Open Access
15 Citations
5,959 Views
19 Pages

Automatic Horizon Picking Using Multiple Seismic Attributes and Markov Decision Process

  • Chengliang Wu,
  • Bo Feng,
  • Xiaonan Song,
  • Huazhong Wang,
  • Rongwei Xu and
  • Shen Sheng

17 January 2023

Picking the reflection horizon is an important step in velocity inversion and seismic interpretation. Manual picking is time-consuming and no longer suitable for current large-scale seismic data processing. Automatic algorithms using different seismi...

(This article belongs to the Special Issue Geophysical Data Processing in Remote Sensing Imagery)
  • Article
  • Open Access
17 Citations
5,060 Views
18 Pages

4 June 2021

During the last decades, collaborative robots capable of operating out of their cages are widely used in industry to assist humans in mundane and harsh manufacturing tasks. Although such robots are inherently safe by design, they are commonly accompa...

(This article belongs to the Special Issue Recent Advances in Assistive Robots)
  • Proceeding Paper
  • Open Access
1,379 Views
6 Pages

1 November 2022

The design optimization of the grading of a resonator array for energy harvesting in sensors is described. Attention is paid to set the resonator heights, possibly removing resonators whenever convenient. Instead of employing time-consuming heuristic...

(This article belongs to the Proceedings of The 9th International Electronic Conference on Sensors and Applications)
  • Article
  • Open Access
3 Citations
2,901 Views
25 Pages

30 September 2021

Hidden Markov model (HMM) is a vital model for trajectory recognition. As the number of hidden states in HMM is important and hard to be determined, many nonparametric methods like hierarchical Dirichlet process HMMs and Beta process HMMs (BP-HMMs) h...

  • Article
  • Open Access
1,778 Views
28 Pages

3 December 2024

In this paper, in order to enhance the autonomous operation capabilities of aircraft and ensure their operational safety and efficiency, we propose an autonomous decision-making framework based on target motion state prediction combined with the Mark...

(This article belongs to the Section Aerospace Actuators)
  • Article
  • Open Access
3 Citations
3,278 Views
23 Pages

We deal with backward stochastic differential equations driven by a pure jump Markov process and an independent Brownian motion (BSDEJs for short). We start by proving the existence and uniqueness of the solutions for this type of equation and presen...

(This article belongs to the Section Probability and Statistics)
  • Article
  • Open Access
2 Citations
2,814 Views
16 Pages

19 July 2024

Recently, studies on early-exit mechanisms have emerged to reduce the computational cost during the inference process of deep learning models. However, most existing early-exit architectures simply determine early exiting based only on a target confi...

(This article belongs to the Section D1: Probability and Statistics)
  • Article
  • Open Access
2 Citations
1,642 Views
17 Pages

29 September 2024

Inducing learning strategies is a crucial component of intelligent tutoring systems. Previous research has predominantly focused on the induction of offline learning strategies. Although the existing offline learning strategy induction methods can al...

(This article belongs to the Special Issue Data-Driven Intelligence in Autonomous Systems)
  • Article
  • Open Access
10 Citations
3,777 Views
18 Pages

30 January 2024

This paper introduces a pioneering model that merges coupled Markov chains (CMC) with the fuzzy analytic hierarchy process (FAHP) to enhance multi-criteria decision making (MCDM) amidst the dynamic interplay of criteria. Traditional MCDM frameworks o...

(This article belongs to the Special Issue New Perspectives in Fuzzy Sets and Their Applications)
  • Article
  • Open Access
6 Citations
3,652 Views
21 Pages

13 February 2020

An approach based on the hidden Markov model (HMM) is proposed for risk performance reasoning (RPR) for the bauxite shipping process by Handy carriers. The unobservable (hidden) state process in the approach aims to model the underlying risk performa...

(This article belongs to the Special Issue Systems Engineering: Availability and Reliability)
  • Article
  • Open Access
22 Citations
5,873 Views
16 Pages

15 March 2019

Online multi-object tracking (MOT) has broad applications in time-critical video analysis scenarios such as advanced driver-assistance systems (ADASs) and autonomous driving. In this paper, the proposed system aims at tracking multiple vehicles in th...

(This article belongs to the Special Issue Intelligent Vehicles)
  • Article
  • Open Access
7 Citations
3,332 Views
14 Pages

17 August 2020

The location of user equipment (UE) should always be maintained in order to connect any incoming calls within a mobile network. While several methods of location registration have been proposed, most mobile networks have adopted zone-based registrati...

(This article belongs to the Collection Big Data Analysis and Visualization Ⅱ)
  • Article
  • Open Access
1,784 Views
18 Pages

In order to connect an incoming call to the user equipment (UE) in a mobile communication network, the location information of the UE must be always kept in the network database. Therefore, the efficiency of the location registration method of report...

(This article belongs to the Topic Electronic Communications, IOT and Big Data)
  • Article
  • Open Access
12 Citations
3,327 Views
27 Pages

29 December 2020

For a G-inhomogeneous semi-Markov chain and G-inhomogeneous Markov renewal processes, we study the change from real probability measure into a forward probability measure. We find the values of risky bonds using the forward probabilities that the bon...

(This article belongs to the Special Issue Stochastic Modeling and Applied Probability)
  • Article
  • Open Access
1 Citations
2,087 Views
17 Pages

3 July 2024

The multimode underwater acoustic communication network is a novel form of underwater acoustic communication that adjusts its communication mode to enhance overall performance. Current performance analysis methods are primarily applied to single-mode...

(This article belongs to the Special Issue Space-Air-Ground-Ocean Integrated Sensing and Information Transmission)
  • Feature Paper
  • Article
  • Open Access
29 Citations
5,161 Views
24 Pages

15 December 2018

The introduction of medical Internet of Things (IoT) for biomedical applications has brought about the era of proactive healthcare. Such advanced medical supervision lies on the foundation of a network of energy-constrained wearable or implantable se...

(This article belongs to the Special Issue Green Communications and Networking for IoT)
  • Article
  • Open Access
6 Citations
3,375 Views
16 Pages

17 March 2022

Many path planning algorithms developed for land or air based autonomous vehicles no longer apply under the water. A time-optimal path planning method for autonomous underwater vehicles (AUVs), based on a Markov decision process (MDP) algorithm, is p...

(This article belongs to the Special Issue New Trends in the Control of Robots and Mechatronic Systems)
  • Article
  • Open Access
10 Citations
6,792 Views
20 Pages

8 September 2022

Whether for institutional investors or individual investors, there is an urgent need to explore autonomous models that can adapt to the non-stationary, low-signal-to-noise markets. This research aims to explore the two unique challenges in quantitati...

(This article belongs to the Special Issue Computational Modeling Approaches to Finance and Fintech Innovation)
  • Article
  • Open Access
2 Citations
2,568 Views
17 Pages

Visual Analysis Method for Traffic Trajectory with Dynamic Topic Movement Patterns Based on the Improved Markov Decision Process

  • Huarong Chen,
  • Yadong Wu,
  • Huaquan Tang,
  • Jing Lei,
  • Guijuan Wang,
  • Weixin Zhao,
  • Jing Liao,
  • Fupan Wang and
  • Zhong Wang

The visual analysis of trajectory topics is helpful for mining potential trajectory patterns, but the traditional visual analysis method ignores the evolution of the temporal coherence of the topic. In this paper, a novel visual analysis method for d...

(This article belongs to the Special Issue Advances in Intelligent Data Analysis and Its Applications, 2nd Edition)
  • Article
  • Open Access
7 Citations
4,436 Views
14 Pages

21 September 2017

The Ka-band and higher Q/V band channels can provide an appealing capacity for the future deep-space communications and Space Information Networks (SIN), which are viewed as a primary solution to satisfy the increasing demands for high data rate serv...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
1 Citations
2,218 Views
17 Pages

9 March 2025

Autonomous vehicles (AVs) are increasingly operating in complex traffic environments where safe and efficient decision-making is crucial. Merging into roundabouts is a key interaction scenario. This paper introduces a decision-making approach for rou...

  • Article
  • Open Access
15 Citations
6,617 Views
20 Pages

6 April 2023

A real-time path planning algorithm based on the Markov decision process (MDP) is proposed in this paper. This algorithm can be used in dynamic environments to guide the wheeled mobile robot to the goal. Two phases (the utility update phase and the p...

(This article belongs to the Special Issue Actuators in 2022)
  • Article
  • Open Access
1 Citations
3,136 Views
20 Pages

18 July 2023

This paper proposes a continuous state partially observable Markov decision process (POMDP) model for the corrosion maintenance of oil and gas pipelines. The maintenance operations include complex and extensive activities to detect the corrosion type...

(This article belongs to the Section Algorithms for Multidisciplinary Applications)
  • Article
  • Open Access
14 Citations
3,639 Views
31 Pages

24 February 2023

This research paper presents studies on the operation process of the Honker 2000 light utility vehicles that are part of the Polish Armed Forces transport system. The phase space of the process was identified based on the assumption that at any given...

(This article belongs to the Special Issue Modeling of Quality, Reliability, and Exploitation for Power Supply Systems, ICT Systems, and Transportation Systems)
  • Feature Paper
  • Article
  • Open Access
782 Views
24 Pages

22 October 2025

We discuss Markov edge processes {Ye;e∈E} defined on edges of a directed acyclic graph (V,E) with the consistency property PE′(Ye;e∈E′)=PE(Ye;e∈E′) for a large class of subgraphs (V′,E′) of (V,E) obtained...

(This article belongs to the Special Issue Modeling and Data Analysis of Complex Networks)
  • Article
  • Open Access
1 Citations
3,234 Views
7 Pages

This paper shows that Harris recurrent Markov chains and processes can be characterized as the class of Markov chains and processes for which there exists a random time T at which the distribution of the chain or process does not depend on its initia...

(This article belongs to the Special Issue Stability Problems for Stochastic Models: Analytics, Asymptotics, Estimation and Applications)
  • Article
  • Open Access
3 Citations
3,421 Views
16 Pages

18 July 2021

In this study, we present a state-based diagnostic and prognostic methodology for lubricating oil degradation based on a nonparametric Bayesian approach, i.e., sticky hierarchical Dirichlet process–hidden Markov model (HDP-HMM). An accurate health st...

  • Article
  • Open Access
1,108 Views
34 Pages

A Markov Decision Process and Adapted Particle Swarm Optimization-Based Approach for the Hydropower Dispatch Problem—Jirau Hydropower Plant Case Study

  • Mateus Santos,
  • Marcelo Fonseca,
  • José Bernardes,
  • Lenio Prado,
  • Thiago Abreu,
  • Edson Bortoni and
  • Guilherme Bastos

16 September 2025

This work focuses on optimizing energy dispatch in a hydroelectric power plant (HPP) with a large number of generating units (GUs) and uncertainties caused by sediment accumulation in the water intakes. The study was realized at Jirau HPP, and integr...

(This article belongs to the Section F: Electrical Engineering)

of 47