Skip to Content

2,222 Results Found

  • Article
  • Open Access
3 Citations
3,389 Views
15 Pages

Note on DNA Analysis and Redesigning Using Markov Chain

  • Maciej Zakarczemny and
  • Małgorzata Zajęcka

21 March 2022

The paper contains a discussion on mathematical modifying and redesigning DNA with the use of Markov chains. We give a simple mathematical technique for overwriting missing parts of DNA. With a certain probability (without even knowing the function o...

(This article belongs to the Section Bioinformatics)
  • Article
  • Open Access
1 Citations
5,189 Views
12 Pages

29 July 2016

We consider the problem of estimating the measure of subsets in very large networks. A prime tool for this purpose is the Markov Chain Monte Carlo (MCMC) algorithm. This algorithm, while extremely useful in many cases, still often suffers from the dr...

  • Feature Paper
  • Article
  • Open Access
10 Citations
5,073 Views
13 Pages

A Markov Chain Model for Mental Health Interventions

  • David Claudio,
  • Sally Moyce,
  • Tyler Albano,
  • Ekeoma Ibe,
  • Nick Miller and
  • Marshall O’Leary

Poor mental health affects nearly one billion people worldwide and can end in suicide if not treated. Unfortunately, stigma and a lack of mental healthcare providers are barriers to receiving needed care. We developed a Markov chain model to determin...

(This article belongs to the Special Issue Editorial Board Members' Collection Series: Prevention and Intervention in Mental Health)
  • Article
  • Open Access
468 Views
25 Pages

11 May 2026

We consider a Markov chain that can be termed a discrete version of Blackwell’s example from 1958. It is constructed with the aid of a sequence of independent Markov chains with two states. It turns out its stationary distribution π and tran...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
7 Citations
2,037 Views
13 Pages

Markov Chain Analysis of Ship Energy Efficiency

  • Yordan Garbatov,
  • Dimitar Yalamov and
  • Petar Georgiev

19 June 2024

A formulation is presented for the assessment of the CO2 generated by ships in operation and their evolution with time, conditional on the current legislation using Markov chains. Any potential deep repair or retrofitting of the ship propulsion syste...

(This article belongs to the Section B3: Carbon Emission and Utilization)
  • Article
  • Open Access
20 Citations
5,623 Views
15 Pages

Scheduling of Preventive Maintenance in Healthcare Buildings Using Markov Chain

  • Jaime González-Domínguez,
  • Gonzalo Sánchez-Barroso and
  • Justo García-Sanz-Calcedo

30 July 2020

The optimization of maintenance in healthcare buildings reduces operating costs and contributes towards increasing the sustainability of the healthcare system. This paper proposes a tool to schedule preventive maintenance for healthcare centers using...

(This article belongs to the Special Issue Reliability Techniques in Industrial Design)
  • Article
  • Open Access
34 Citations
10,291 Views
29 Pages

3 June 2014

Recent work incorporating geometric ideas in Markov chain Monte Carlo is reviewed in order to highlight these advances and their possible application in a range of domains beyond statistics. A full exposition of Markov chains and their use in Monte C...

(This article belongs to the Special Issue Information Geometry)
  • Feature Paper
  • Article
  • Open Access
63 Citations
8,304 Views
15 Pages

A Probabilistic Short-Term Water Demand Forecasting Model Based on the Markov Chain

  • Francesca Gagliardi,
  • Stefano Alvisi,
  • Zoran Kapelan and
  • Marco Franchini

12 July 2017

This paper proposes a short-term water demand forecasting method based on the use of the Markov chain. This method provides estimates of future demands by calculating probabilities that the future demand value will fall within pre-assigned intervals...

(This article belongs to the Special Issue Advanced Hydroinformatic Techniques for the Simulation and Analysis of Water Supply and Distribution Systems)
  • Feature Paper
  • Review
  • Open Access
5 Citations
4,376 Views
20 Pages

21 June 2025

Markov chain perturbation theory is a rapidly developing subfield of the theory of stochastic processes. This review outlines emerging applications of this theory in the analysis of stochastic models of chemical reactions, with a particular focus on...

(This article belongs to the Section D1: Probability and Statistics)
  • Article
  • Open Access
24 Citations
4,761 Views
16 Pages

An Absorbing Markov Chain Model to Predict Dairy Cow Calving Time

  • Swe Zar Maw,
  • Thi Thi Zin,
  • Pyke Tin,
  • Ikuo Kobayashi and
  • Yoichiro Horii

28 September 2021

Abnormal behavioral changes in the regular daily mobility routine of a pregnant dairy cow can be an indicator or early sign to recognize when a calving event is imminent. Image processing technology and statistical approaches can be effectively used...

(This article belongs to the Collection Advances in Sensors, Big Data and Machine Learning in Intelligent Animal Farming)
  • Article
  • Open Access
4 Citations
5,578 Views
18 Pages

Projecting Mortality Rates Using a Markov Chain

  • Jaap Spreeuw,
  • Iqbal Owadally and
  • Muhammad Kashif

3 April 2022

We present a mortality model where future stochastic changes in population-wide mortality are driven by a finite-state hierarchical Markov chain. A baseline mortality in an initial ‘Alive’ state is calculated as the average logarithm of t...

(This article belongs to the Special Issue Markov-Chain Modelling and Applications)
  • Article
  • Open Access
171 Citations
15,352 Views
33 Pages

13 May 2015

In this study, urban growth of the Atakum District in Samsun, Turkey, was simulated by Cellular Automata-Markov Chain (CA-MC) and Multi-layer Perceptron-Markov Chain (MLP-MC) hybrid models in a geographical information system (GIS) environment. Histo...

  • Article
  • Open Access
5 Citations
2,073 Views
14 Pages

2 June 2023

The switching system model of a closed-loop supply chain with Markov jump parameters is established. The system is modeled as a switching system with Markov jump parameters, taking into account the uncertainties of the process and the inventory decay...

(This article belongs to the Special Issue Practical Applications of New Optimization Methods and Intelligent Control)
  • Article
  • Open Access
13 Citations
2,981 Views
16 Pages

31 March 2021

This study improves an approach for Markov chain-based photovoltaic-coupled energy storage model in order to serve a more reliable and sustainable power supply system. In this paper, two Markov chain models are proposed: Embedded Markov and Absorbing...

(This article belongs to the Section Energy Sustainability)
  • Article
  • Open Access
40 Citations
10,278 Views
11 Pages

Markov Chain Model Development for Forecasting Air Pollution Index of Miri, Sarawak

  • Nurul Nnadiah Zakaria,
  • Mahmod Othman,
  • Rajalingam Sokkalingam,
  • Hanita Daud,
  • Lazim Abdullah and
  • Evizal Abdul Kadir

22 September 2019

A Markov chain is commonly used in stock market analysis, manpower planning, and in many other areas because of its efficiency in predicting long run behavior. However, the Air Quality Index (AQI) suffers from not using a Markov chain in its forecast...

(This article belongs to the Section Sustainable Chemical Engineering and Technology)
  • Feature Paper
  • Article
  • Open Access
10 Citations
8,801 Views
24 Pages

On the Structure of the World Economy: An Absorbing Markov Chain Approach

  • Olivera Kostoska,
  • Viktor Stojkoski and
  • Ljupco Kocarev

23 April 2020

The expansion of global production networks has raised many important questions about the interdependence among countries and how future changes in the world economy are likely to affect the countries’ positioning in global value chains. We are...

(This article belongs to the Special Issue Dynamic Processes on Complex Networks)
  • Article
  • Open Access
113 Citations
20,003 Views
23 Pages

Urban expansion is considered as one of the most important problems in several developing countries. Bangkok Metropolitan Region (BMR) is the urbanized and agglomerated area of Bangkok Metropolis (BM) and its vicinity, which confronts the expansion p...

(This article belongs to the Special Issue Development of Sustainable Rural Regions in the Face of Increasing Globalization and Urbanization)
  • Article
  • Open Access
14 Citations
4,447 Views
17 Pages

10 December 2017

A practical probabilistic data association filter is proposed for tracking multiple targets in clutter. The number of joint data association events increases combinatorially with the number of measurements and the number of targets, which may become...

(This article belongs to the Section Physical Sensors)
  • Article
  • Open Access
8 Citations
4,597 Views
19 Pages

30 December 2018

In multiple detection target tracking environments, PDA-based algorithms such as multiple detection joint integrated probabilistic data association (MD-JIPDA) utilize the measurement partition method to generate measurement cells. Thus, one-to-many t...

(This article belongs to the Special Issue Multiple Object Tracking: Making Sense of the Sensors)
  • Article
  • Open Access
7 Citations
3,335 Views
15 Pages

A Markov Chain Approach to Multicriteria Decision Analysis with an Application to Offshore Decommissioning

  • Fernanda F. Moraes,
  • Virgílio José M. Ferreira Filho,
  • Carlos Eduardo Durange de C. Infante,
  • Luan Santos and
  • Edilson F. Arruda

23 September 2022

This paper proposes a novel approach that makes use of continuous-time Markov chains and regret functions to find an appropriate compromise in the context of multicriteria decision analysis (MCDA). This method was an innovation in the relationship be...

(This article belongs to the Section Energy Sustainability)
  • Feature Paper
  • Article
  • Open Access
6 Citations
5,520 Views
16 Pages

21 October 2017

Markov chain Monte Carlo sampling propagators, including numerical integrators for stochastic dynamics, are central to the calculation of thermodynamic quantities and determination of structure for molecular systems. Efficiency is paramount, and to a...

(This article belongs to the Special Issue Understanding Molecular Dynamics via Stochastic Processes)
  • Article
  • Open Access
47 Citations
7,247 Views
22 Pages

26 January 2022

To address the urgent need to accurately predict the spreading trend of the COVID-19 epidemic, a continuous Markov-chain model was, for the first time, developed in this work to predict the spread of COVID-19 infection. A probability matrix of infect...

(This article belongs to the Special Issue Theories and Models on COVID-19 Epidemics)
  • Article
  • Open Access
8 Citations
4,175 Views
16 Pages

Markov Chain Modeling for Predicting the Service Life of Buildings and Structural Components

  • Artur Zbiciak,
  • Dariusz Walasek,
  • Mykola Nagirniak,
  • Katarzyna Walasek and
  • Eugeniusz Koda

24 August 2025

Accurate prediction and management of the service life of buildings and structural components are crucial for ensuring durability and economic efficiency. This paper investigates both discrete- and continuous-time Markov chains as probabilistic model...

  • Article
  • Open Access
81 Citations
4,842 Views
18 Pages

Unsupervised Saliency Model with Color Markov Chain for Oil Tank Detection

  • Ziming Liu,
  • Danpei Zhao,
  • Zhenwei Shi and
  • Zhiguo Jiang

7 May 2019

Traditional oil tank detection methods often use geometric shape information. However, it is difficult to guarantee accurate detection under a variety of disturbance factors, especially various colors, scale differences, and the shadows caused by vie...

(This article belongs to the Special Issue Remote Sensing for Target Object Detection and Identification)
  • Article
  • Open Access
13 Citations
3,742 Views
27 Pages

State Estimation of an Underwater Markov Chain Maneuvering Target Using Intelligent Computing

  • Wasiq Ali,
  • Yaan Li,
  • Muhammad Asif Zahoor Raja,
  • Wasim Ullah Khan and
  • Yigang He

29 August 2021

In this study, an application of deep learning-based neural computing is proposed for efficient real-time state estimation of the Markov chain underwater maneuvering object. The designed intelligent strategy is exploiting the strength of nonlinear au...

(This article belongs to the Special Issue Entropy and Information Theory in Acoustics II)
  • Article
  • Open Access
5 Citations
4,419 Views
17 Pages

Financial Sustainability Evaluation and Forecasting Using the Markov Chain: The Case of the Wine Business

  • Nataliya Rekova,
  • Hanna Telnova,
  • Oleh Kachur,
  • Iryna Golubkova,
  • Tomas Baležentis and
  • Dalia Streimikiene

30 July 2020

This paper proposes a framework for assessing the financial sustainability of a wine producing company. The probabilistic approach is used to model the expected changes in the financial situation of an enterprise based on the historical trends. The c...

(This article belongs to the Special Issue Sustainability Assessment)
  • Article
  • Open Access
5 Citations
3,174 Views
18 Pages

19 November 2018

Establishing fast and reversible photon multiple scattering algorithms remains a modeling challenge for optical diagnostics and noise reduction purposes, especially when the scattering happens within the intermediate scattering regime. Previous work...

  • Article
  • Open Access
1 Citations
2,718 Views
13 Pages

17 August 2020

By means of compressive sampling (CS), a sparse signal can be efficiently recovered from its far fewer samples than that required by the Nyquist–Shannon sampling theorem. However, recovering a speech signal from its CS samples is a challenging...

(This article belongs to the Section Intelligent Sensors)
  • Article
  • Open Access
1 Citations
2,286 Views
12 Pages

28 October 2022

Structural network pruning is an effective way to reduce network size for deploying deep networks to resource-constrained devices. Existing methods mainly employ knowledge distillation from the last layer of network to guide pruning of the whole netw...

  • Article
  • Open Access
2 Citations
4,316 Views
27 Pages

Ribonucleic acid (RNA) secondary structures and branching properties are important for determining functional ramifications in biology. While energy minimization of the Nearest Neighbor Thermodynamic Model (NNTM) is commonly used to identify such pro...

(This article belongs to the Section Natural Sciences)
  • Article
  • Open Access
6 Citations
3,586 Views
23 Pages

Saliency Detection with Bilateral Absorbing Markov Chain Guided by Depth Information

  • Jiajia Wu,
  • Guangliang Han,
  • Peixun Liu,
  • Hang Yang,
  • Huiyuan Luo and
  • Qingqing Li

27 January 2021

The effectiveness of depth information in saliency detection has been fully proved. However, it is still worth exploring how to utilize the depth information more efficiently. Erroneous depth information may cause detection failure, while non-salient...

(This article belongs to the Section Sensing and Imaging)
  • Article
  • Open Access
4 Citations
3,317 Views
12 Pages

7 March 2024

This paper proposes a genetic algorithm-based Markov Chain approach that can be used for non-parametric estimation of regression coefficients and their statistical confidence bounds. The proposed approach can generate samples from an unknown probabil...

(This article belongs to the Special Issue Nature-Inspired Algorithms in Machine Learning (2nd Edition))
  • Article
  • Open Access
25 Citations
4,836 Views
25 Pages

In order to improve the dynamic optimization of fleet size and standardized management of dockless bike-sharing, this paper focuses on using the Markov stochastic process and linear programming method to solve the problem of bike-sharing fleet size a...

  • Article
  • Open Access
2 Citations
1,913 Views
16 Pages

1 May 2024

We present a two-country model (North and South) that describes the phenomenon of offshoring and reshoring. The model is a continuous time-controlled Markov chain with binary states. The main trade-off involves production costs and transaction costs...

(This article belongs to the Special Issue Advances in Mathematics: Theory and Applications)
  • Article
  • Open Access
5 Citations
2,708 Views
14 Pages

CRA: Identifying Key Classes Using Markov-Chain-Based Ranking Aggregation

  • Xin Du,
  • Weifeng Pan,
  • Bo Jiang,
  • Luyun Ding,
  • Yun Pan,
  • Chengxiang Yuan and
  • Yiming Xiang

22 September 2022

Researchers have proposed many approaches to identify key classes in software from the perspective of complex networks, such as CONN-TOTAL-W, PageRankBR, and ElementRank, which can effectively help developers understand software. However, these appro...

  • Article
  • Open Access
1 Citations
3,635 Views
16 Pages

Performance analysis and design space exploration of bufferless Networks-on-Chip is done mainly through time-consuming cycle-accurate simulation, due to the chaotic nature of packet deflections, which have thus far prevented the development of an acc...

(This article belongs to the Special Issue MOCAST 2021)
  • Article
  • Open Access
2,599 Views
12 Pages

Analyzing Respiratory Sinus Arrhythmia: A Markov Chain Approach with Hypertensive Patients and Arachnophobic Individuals

  • Erika Elizabeth Rodriguez-Torres,
  • María Fernanda Azpeitia-Cruz,
  • Jaqueline Escamilla-Muñoz and
  • Isaac Vázquez-Mendoza

20 June 2024

Respiratory Sinus Arrhythmia (RSA) manifests as cyclic fluctuations in heart rate in synchrony with breathing. Gaining insights into the dynamics of RSA within the cardiac muscle functioning is crucial for comprehending its physiological and clinical...

  • Article
  • Open Access
3 Citations
1,427 Views
11 Pages

21 November 2024

Discrete, finite-state Markov chains are applied in many different fields. When a system is modeled as a discrete, finite-state Markov chain, the asymptotic properties of the system, such as the steady-state distribution, are often estimated based on...

(This article belongs to the Section D1: Probability and Statistics)
  • Article
  • Open Access
9 Citations
4,686 Views
21 Pages

Detecting Intra-Urban Housing Market Spillover through a Spatial Markov Chain Model

  • Daijun Zhang,
  • Xiaoqi Zhang,
  • Yanqiao Zheng,
  • Xinyue Ye,
  • Shengwen Li and
  • Qiwen Dai

This study analyzed the spillovers among intra-urban housing submarkets in Beijing, China. Intra-urban spillover imposes a methodological challenge for housing studies from the spatial and temporal perspectives. Unlike the inter-urban spillover, the...

(This article belongs to the Special Issue Geospatial Methods in Social and Behavioral Sciences)
  • Proceeding Paper
  • Open Access
413 Views
6 Pages

Markov Chain–Based Analysis of Hydrological Drought Transitions in the Nestos River Basin

  • Konstantinos Spiliotis,
  • Mike Spiliotis,
  • Charalampos Skoulikaris,
  • Stamatios Petkopoulos,
  • Dimitris Bourdis and
  • George Kampas

In this study Markov chains process in combination with chi-squared test were applied to hydrological drought dataset of Nestos hydrosystem to highlight the drought transition attitude from one drought state to another. This examined hydrosystem is o...

  • Article
  • Open Access
1 Citations
2,099 Views
13 Pages

CluMP: Clustered Markov Chain for Storage I/O Prefetch

  • Sungmin Jung,
  • Hyeonmyeong Lee and
  • Heeseung Jo

Due to advancements in CPU and storage technologies, the processing speed of tasks has been increasing. However, there has been a relative slowdown in the data transfer speeds between disks and memory. Consequently, the issue of I/O processing speed...

(This article belongs to the Section Computer Science & Engineering)
  • Article
  • Open Access
1 Citations
2,409 Views
14 Pages

Discrete-Time Markov Chain Method for Predicting Probability of Crop Yield Variability

  • László Huzsvai,
  • Elza Kovács,
  • Géza Tuba,
  • Csaba Juhász,
  • Danijel Jug and
  • József Zsembeli

6 November 2025

Agricultural crop yield prediction is vital for ensuring global food security and optimizing resource management amid the increasing challenges posed by climate change and extreme weather variability. This study investigates the use of discrete-time,...

(This article belongs to the Topic Advances in Crop Simulation Modelling)
  • Article
  • Open Access
13 Citations
5,271 Views
17 Pages

16 January 2020

Bias correction methods are routinely used to correct climate model outputs for hydrological and agricultural impact studies. Even though superior bias correction methods can correct the distribution of daily precipitation amounts, as well as the wet...

(This article belongs to the Section Biometeorology and Bioclimatology)
  • Article
  • Open Access
1 Citations
2,885 Views
19 Pages

Application of the Coupled Markov Chain in Soil Liquefaction Potential Evaluation

  • Hsiu-Chen Wen,
  • An-Jui Li,
  • Chih-Wei Lu and
  • Chee-Nan Chen

29 November 2022

The evaluation of localized soil-liquefaction potential is based primarily on the individual evaluation of the liquefaction potential in each borehole, followed by calculating the liquefaction-potential index between boreholes through Kriging interpo...

(This article belongs to the Special Issue Advances in Soils and Foundations)
  • Article
  • Open Access
2 Citations
2,158 Views
20 Pages

17 September 2022

The object under investigation is a controllable linear stochastic differential system affected by some external statistically uncertain piecewise continuous disturbances. They are directly unobservable but assumed to be a continuous-time Markov chai...

(This article belongs to the Special Issue Mathematical Modeling, Optimization and Machine Learning)
  • Article
  • Open Access
3 Citations
3,622 Views
27 Pages

Real-Time Handover in LEO Satellite Networks via Markov Chain-Guided Simulated Annealing

  • Mohammad A. Massad,
  • Abdallah Y. Alma’aitah and
  • Hossam S. Hassanein

3 November 2025

This paper presents a real-time handover and link assignment framework for low-Earth-orbit (LEO) satellite networks operating in dense urban canyons. The proposed Markov chain-guided simulated annealing (MCSA) algorithm optimizes user-to-satellite as...

(This article belongs to the Special Issue Advances in Wireless Communications and Networks)
  • Feature Paper
  • Article
  • Open Access
12 Citations
6,978 Views
13 Pages

13 October 2017

Grey prediction models for time series have been widely applied to demand forecasting because only limited data are required for them to build a time series model without any statistical assumptions. Previous studies have demonstrated that the combin...

(This article belongs to the Section Information Systems)
  • Article
  • Open Access
1 Citations
3,286 Views
26 Pages

This paper presents a stochastic Markov chain model for estimating new entrants into professional orders and their related pension funds. The model considers the interactions between demographic, socio-economic and regulatory variables. The intuition...

(This article belongs to the Special Issue The Future of Banking Risk and Regulation)
  • Article
  • Open Access
2 Citations
1,808 Views
13 Pages

28 September 2023

The use of individual calving pens in modern farming is widely recognized as a good practice for promoting good animal welfare during parturition. However, determining the optimal time to move a pregnant cow to a calving pen can be a management chall...

(This article belongs to the Section Physical Sensors)

of 45