Next Article in Journal
Pathways between Climate, Fish, Fisheries, and Management: A Conceptual Integrated Ecosystem Management Approach
Next Article in Special Issue
EE-UWSNs: A Joint Energy-Efficient MAC and Routing Protocol for Underwater Sensor Networks
Previous Article in Journal
Quantifying Estuarine Hydrometeorological Coastal Hazards Using a Combined Field Observation and Modeling Approach
Previous Article in Special Issue
An Automatic Search and Energy-Saving Continuous Tracking Algorithm for Underwater Targets Based on Prediction and Neural Network
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Tracking Algorithm for Sparse and Dynamic Underwater Sensor Networks

College of Intelligent Systems Science and Engineering, Harbin Engineering University, Harbin 150001, China
*
Author to whom correspondence should be addressed.
J. Mar. Sci. Eng. 2022, 10(3), 337; https://doi.org/10.3390/jmse10030337
Submission received: 19 January 2022 / Revised: 24 February 2022 / Accepted: 25 February 2022 / Published: 28 February 2022
(This article belongs to the Special Issue Underwater Sensor Networks (UWSNs))

Abstract

:
An underwater sensor network (UWSN) has sparse and dynamic characteristics. In sparse and dynamic UWSNs, the traditional particle filter based on multi-rate consensus/fusion (CF/DPF) has the problems of a slow convergence rate and low filtering accuracy. To solve these problems, a tracking algorithm for sparse and dynamic UWSNs based on particle filter (TASD) is proposed. Firstly, the estimation results of a local particle filter are processed by a weighted average consensus filter (WACF). In this way, the reliability difference of state estimation between nodes in sparse and dynamic UWSN is reasonably eliminated. Secondly, a delayed update mechanism (DUM) is added to WACF, which effectively solves the problem of time synchronization between the two particle filters. Thirdly, under the condition of limited communication energy consumption, an alternating random scheme (ARS) is designed, which optimizes the mean square convergence rate of the fusion particle filter. Simulation results show that the proposed algorithm can be applied to maneuvering target tracking in sparse and dynamic UWSN effectively. Compared with the traditional method, it has higher tracking accuracy and faster convergence speed. The average estimation error of TASD is 91.3% lower than that of CF/DPF, and the weighted consensus tracking error of TASD is reduced by 85.6% compared with CF/DPF.

1. Introduction

UWSNs are currently used in a variety of fields. For example, environment monitoring and modeling, target detection and tracking, collaborative multi-agent system navigation [1], and so on. The restricted sensing and communication range of sensor nodes, communication link failure, node mobility, and other factors could all contribute to the sparsity and random dynamics (in practice). They are the main unstable factors of communication topology in UWSN [2,3]. Furthermore, UWSN-based systems frequently have some unique characteristics, such as a non-linear model and non-Gaussian statistical noise characteristics.
The application of UWSN relies heavily on the fusion of state estimation results from multiple sources in different sensor nodes. Nowadays, the fusion methods applied in UWSN can be divided into centralized and distributed schemes [4,5,6]. The centralized technique requires a fusion center to collect the measurement information of all other sensor nodes under the premise of reliable communication in UWSN. The centralized method has the advantage of providing the fusion center with all of the information from all nodes, allowing it to generate the best estimation results. However, because the fusion center requires high computational power and fault tolerance, the UWSN communication network assumption is unrealistic.  The entire network will be crippled if the fusion center fails. The distributed technique eliminates the requirement for a single information fusion center and allows nodes to communicate and process data in parallel with their neighbors.  As a result, in terms of communication complexity and fault tolerance, it clearly outperforms the centralized method [7]. Accordingly, the distributed method has become the focus and a “hot issue" in the field of multi-source information fusion in UWSN gradually [8,9]. According to the different adaptabilities of UWSN communication topology, the distributed method can be divided into two forms: message passing form represented by channel filter, and message diffusion form represented by distributed filter based on consensus algorithm [10,11,12]. Among them, the message passing form relies on special communication topologies, such as tree or ring; it cannot be applied to the random dynamic communication topology. There are many methods in the form of message de-fusion. In particular, the distributed filter based on the consensus algorithm only needs single hop communication between neighbor nodes, so it can be used in various communication topologies. Therefore, it becomes the main research direction of distributed methods. From the above contents, we can see that the form of communication topology deeply influences the development direction of the distributed research method  [13,14].
In actual applications, the dispersion of nodes in underwater sensor networks is sparse in order to control the investment cost. Furthermore, because the ocean is a massive dynamic circulation system, the nodes in the ocean cannot be fixed. In recent years, references [15,16,17,18,19,20,21,22,23,24,25,26,27,28] studied the distributed filter based on the consensus algorithm under sparse and dynamic communication conditions, respectively. In references [15,17,18], the authors improve the Kalman consistence filter (KCF) [29] by fusing their weighting scheme with the original scheme. In this way, KCF can be better used in sparse camera networks. The adverse factors caused by invalid nodes [17] are considered in [16,18]; they designed the cascaded distributed unscented information filter (DUIF) dominated by the weighted average consensus filtering mechanism and distributed particle filter (DPF), and completed the maneuvering target tracking task in the simulation of sparse UWSN. In [30], a localization strategy based on adaptive AUV, with the goal of providing network-wide localization services for sensor nodes in sparse underwater sensor networks with high-speed autonomous underwater robots. For sparse underwater sensor networks, an opportunistic location scheme based on topology control is proposed [31]. However, in a random and dynamic communication topology, the discontinuity of undirected graph connectivity and packet loss may lead to the failure of the above methods. According to the characteristics of the random dynamic communication topology, the authors in references [19,20,21] assumed that the random changes of communication topology obey the Bernoulli distribution, and they designed a distributed Kalman filter (DKF) that could effectively run in dynamic communication topology. Based on the Kalman–Bucy filter and classical Lyapunov method, ref. [22] designed a continuous time DKF algorithm with upper and lower bounds of the global mean square error to realize target tracking in dynamic UWSN. References [23,24,25] designed the distributed H filtering algorithm, which could be applied in random dynamic UWSN to fuse multi-source information. Two new distributed Bayesian filtering algorithms are proposed in [26,27]. Their purpose is to eliminate the problem of asynchrony in dynamic communication topology. They could reduce the iteration times of the consensus algorithm in a distributed estimation process. The localization of underwater targets can also be completed based on the selection of dynamic parameters. The architecture of this location environment is dynamic [32].
The algorithms in the above have their own advantages. However, these traditional algorithms still face various challenges, which need to be studied further: (1) Could the algorithm be suitable for UWSNs with sparse and dynamic characteristics? (2) If the algorithm could be applied to sparse and dynamic UWSNs, how does one improve the estimation accuracy? (3) If the estimation accuracy of the algorithm is effectively improved, can the convergence rate of the consensus algorithm be optimized on this basis?
In view of the above three progressive research problems, a tracking algorithm for sparse and dynamic UWSNs (TASD) proposed in this paper. The main contributions of this paper are as follows:
(1)
It is assumed that the communication energy consumption of each observation node in UWSN is limited. The alternating random scheme (ARS) under communication cost constraints is designed to maximize the second smallest eigenvalue of the average Laplace matrix. The simulation results show that the mean square convergence rate of the fusion particle filter is effectively accelerated by this method.
(2)
The weighted average consensus filter (WACF) is introduced. And the weight matrix is obtained by the dynamic optimization process of ARS. WACF eliminates the difference in reliability of state estimation caused by invalid nodes of sparse and dynamic UWSN reasonably, then improves the estimation accuracy.
(3)
A delayed update mechanism (DUM) is added to WACF, which effectively solves the problem of time synchronization between the two particle filters.
The overall structure of the article is: the basic model of the system is established and the overview of the algorithm is in Section 2. A tracking algorithm for sparse and dynamic underwater sensor networks is presented in Section 3. The simulation experiment is shown in Section 4. Finally, the conclusion is in Section 5.

2. Models and Problems

(1)
System model.
In a sparse and dynamic UWSN with N n o d e sensor nodes, at time k 1 k , for i 1 i N n o d e , measurement z k i is made by node i. Then, the observation and state can be modeled as:
z k i = h i x k , k + υ k n
x k = f x k 1 , k + ω k 1
where z k i R p and x k R q are observation variables and state variables, respectively. f · and h · are non-linear functions. The last term of the above two formulas υ k n R p and ω k 1 R q represent noise. E ω s ω k T   = Q k δ k s and E υ s n υ k n T   = R k n δ k s are the known noise information. Here, Q k and R k i are positive definite matrices.
(2)
Network model.
In order to control the deployment cost of the platform, the node distribution in UWSN is sparse. As a super large dynamic circulation system, any object in the ocean cannot be static. The paper constructs a sparse and dynamic network model: here, we choose undirected graph G k =   V , ε k to describe the communication topology of the network at time k 1 k . The set of sensor nodes is V and V   = N n o d e . ε k is the set of effective communication connection edges, and its cardinality is the number of effective communication connection edges M k ; that is ε k   = M k . Moreover, in the sparse and dynamic UWSN, M k satisfies [28]:
M k N n o d e N n o d e 1 / 2
At the same time, the assumptions about the random dynamic change of ε k are made:
Assumption 1.
The probability of effective communication connection between node n ( 1 n N n o d e ) and l ( 1 l N n o d e , l n ) obeys Bernoulli distribution:
P n , l ε k   = P n l 0 , 1 , P n , l ε k   = 1 P n l
Assumption 2.
The random dynamic changes of different effective communication links are independent events.
Assumption 3.
For n ( 1 n N n o d e ) and l ( 1 l N n o d e , l n ) , the value of P n l is constant in any iteration of the consensus algorithm.
Based on the above three assumptions, in order to facilitate the elaboration and analysis of the problem, the average network undirected graph of sparse and dynamic UWSN is investigated. A k and L k are the adjacency matrix and Laplace matrix of undirected graph G k , respectively. The average adjacency matrix A ¯ and the average Laplace matrix L ¯ are:
A ¯ = E A k   = P = P n l N n o d e × N n o d e , L ¯ = E L k   = D ¯ A ¯ = L ¯ n l N n o d e × N n o d e
where D ¯ is the average degree matrix, and calculation equation of L ¯ n l is:
L ¯ n l = m = 1 N n o d e P n m , i f   n = l P n l , o t h e r w i s e
(3)
Problems need to be solved.
Multi-rate consensus/fusion filtering algorithm [28] (CF/DPF) is suitable for a nonlinear system model and non-Gaussian noise. It is mainly used in distributed multi-sensor navigation and tracking, and it primarily solves the problem of data fusion in UWSNs. In essence, the algorithm is an extended application of a particle filter. Two kinds of particle filters run in parallel. The first is the local particle filter, which estimates the global state vector in each sensor node. The second is the fusion particle filter. For 1 n N n o d e , node n obtains the neighboring node observation information, and it uses fusion particle filter to compensate this information. It unifies the information of local filtering distribution and local prediction distribution, and assimilates them into the information of global posterior distribution.
However, if the distribution of sensor nodes is sparse and the communication connection between sensor nodes is dynamic, the tracking result of CF/DPF will show a slow convergence rate and low tracking accuracy. The following figures show the tracking results only with CF/DPF. The simulation environment of Figure 1a is a non-dynamic UWSN, and the communication radius of nodes is longer than that of Figure 1b. The communication network is called the dense network. The simulation environment in Figure 1b is a sparse and dynamic UWSN. It can be seen that the network connection condition changes from a dense network to a sparse and dynamic UWSN, the tracking trajectory fluctuates greatly and the convergence rate is slow. If the CF/DPF can be improved to make it suitable for sparse and dynamic networks, its application fields will be broadened.

3. TASD

In this section, a tracking algorithm for sparse and dynamic underwater sensor networks (TASD) is proposed. Based on the mathematical model of a sparse and dynamic network, the traditional CD/DPF is optimized and improved. The algorithm is optimized to eliminate the influence of invalid nodes in a sparse and dynamic network and maximize the second smallest eigenvalue of the average Laplace matrix.
TASD has two kinds of particle filters that run in parallel, and it has a cascade structure of information flow. Furthermore, the dynamic and sparse characteristic of UWSNs are considered; that is, the communication links between observation nodes change dynamically with a certain probability. Finally, the fusion filtering problem in UWSNs with limited communication energy is considered in TASD.
TASD uses the weighted average consensus filter (WACF) to eliminate the influence of invalid nodes, so as to improve the estimation accuracy of CF/DPF. Moreover, TASD adds a delayed update mechanism (DUM) to WACF, which effectively solves the problem of the time difference between the local and fusion particle filters. Not only that, when the energy of sensor nodes is limited, TASD uses an alternating random scheme (ARS) to improve the mean square convergence rate of CF/DPF. The principle of TASD is shown in Figure 2.

3.1. Alternating Random Scheme (ARS)

Based on the assumptions proposed in the paper, in the average network G ¯ , the communication topology of UWSNs with sparse and dynamic characteristics changes randomly and dynamically with a certain probability. In this case, the study of convergence is essential [33]. Therefore, this paper adopts several lemmas, which are all about the convergence of the average consensus algorithm [34]:
Lemma 1.
For an initial state vector x 0 R N n o d e × 1 . At time t + 1 , the state is x t + 1 . x a v g is the average consistence value of the state. Moreover, ρ · is the spectral radius. The value of U t is assumed to be independent and identically distributed,;the convergence of the average consensus algorithm requires a necessary and sufficient condition, which is expressed in a special form as:
x t + 1 x a v g 2   k = 0 t ρ U t 11 T / N n o d e x 0 x a v g 2
Lemma 2.
If E ρ U 1 1 T / N < 1 , then lim t E x t x a v g 2 = 0 .
On the basis of Lemma 2, the mean square convergence factor C α , L ¯ and mean square convergence rate S g α , L ¯ of the average consensus algorithm are expressed as:
C α , L ¯ = E ρ U 11 T / N n o d e S g α , L ¯ = ln C α , L ¯ = ln E ρ U 11 T / N n o d e 1
The smaller the value of the mean square convergence factor, the bigger the value of the mean square convergence rate. α is assumed to be assigned the value of α = 1 / 2 d max , where d max is the maximum communication distance between nodes, and placed in all communication connection edges:
C α , L ¯   = 1 1 / 2 d max E λ 2 L   < 1 , S g α , L ¯   = ln 1 1 / 2 d max E λ 2 L
Equation (9) shows the bigger the value of E λ 2 L , so as to improve mean square convergence rate. There exists a positive correlation between the values of E λ 2 L and λ 2 L ¯ . It is simple to analyze and calculate the value of λ 2 L ¯ . The larger the value of λ 2 L ¯ , the faster the mean square convergence rate.
Lemma 3.
L ¯ is the mean Laplace matrix. It is a positive semi-definite matrix, and its eigenvalues can be arranged:
0 = λ 1 L ¯   λ 2 L ¯   λ 3 L ¯   · · · λ N L ¯
where λ 2 L ¯ > 0 is a necessary and sufficient condition for G ¯ being connected. In this paper, λ 2 L ¯ is the algebraic connectivity of the average network communication topology undirected graph G ¯ . The value of λ 2 L ¯ is directly proportional to the degree of sparse communication topology in UWSNs [35].
TASD is applied to sparse and dynamic UWSNs, the communication connections are assumed to change with probability matrix P dynamically. If the value of λ 2 L ¯ is blindly increased, not only will the mean square convergence rate improve, the communication energy will increase. However, in practical applications, the energy of communication nodes is limited. In order to maximize the value of λ 2 L ¯ under the above conditions, an alternating random scheme (ARS) under communication cost constraints is designed to calculate:
max L ¯ λ 2 L ¯ , s . t . L ¯ = L ¯ T R N × N , 1 L ¯ i j 0 , i , j V , i j , L ¯ 1 = 0 , 1 / 2 t r C L ¯   E n .
The above is a formulaic description of the optimal conditions. E n is the maximum value of the energy. C represents a matrix of energy, and it satisfies C = C i j N n o d e × N n o d e T = C T . C i j is the communication energy consumption between nodes i and j, ( 1 i N n o d e , 1 j N n o d e ) , which is defined as:
C i j = η d i j 2 , i , j ε , o t h e r w i s e
where η is the scale parameter, and  d i j represents the Euclidean distance between nodes i and j.
The application of equation mentioned above belongs to the semi-definite programming methods (SDP). The specific method is that SDP is used to adjust the probability matrix P in Assumption 1, dynamically and optimally, then the other matrices related to it will be dynamically optimized. The dynamic calculation process includes the use of (5) and (6). Finally, λ 2 L ¯ is maximized to achieve the overall dynamic topology optimization function.
To summarize, ARS optimizes the mean square convergence rate of the fusion particle filter. The improvement of the mean square convergence rate shortens the time delay of fusion filtering, which can be described as “killing two birds with one stone”. It is worth mentioning that the design of ARS is based on the condition that the energy of sensor nodes is limited, which makes the service conditions of TASD meet the reality.

3.2. Weighted Average Consensus Filter (WACF) with Delayed Update Mechanism (DUM)

Lemma 4.
If λ 2 L ¯   > 0 , then G ¯ is connected. The average consensus algorithm is given by:
x k + 1 n = W k n n x k n + l N k n W k n l x k l , n , l V
The state estimation variables x k of all observation nodes will converge to the average consensus value x a v g ; that is lim k E x k x a v g 2 = 0 . Moreover, x k n is the state variable of node n n N n o d e at k. N k n =   l V | n , l ε k represents the set of neighboring nodes for node n n N n o d e . W k n l and W k n n are weights and satisfy W k n n + l N k n W k n l = 1 . At the same time, if the initial state vector is x 0 , then the average consensus value is x a v g = 11 T / N n o d e x 0 , where 1 is the unit column vector [33].
TASD uses WACF of (13) in Lemma 4 to estimate the local particle filter distribution and local particle prediction distribution with Gaussian approximation. However, the application environment of this paper is sparse and dynamic UWSN, and the weight matrix is “time-varying” and each element in the weight matrix is given by ARS in Section 3.1.
The form of vector representation of the algorithm shown in (13) is:
ψ k + 1 = t = 0 k W t , x k + 1 = ψ k + 1 x 0
Based on the average network model of sparse and dynamic UWSN, the weight matrix is W k = I α L ¯ k . Then, the average weight matrix corresponding to the average network model is W ¯ = I α L ¯ . The convergence characteristics of (14) are analyzed, based on Lemma 4. Then (14) converges to the average consensus value x a v g = 11 T / N n o d e x 0 . Moreover,
x a v g = lim k x k = lim k t = 0 k 1 W t x 0 = lim k ψ k x 0 = 11 T / N n o d e x 0
It is assumed that the fusion particle filter has run to the iteration k 1 k . Moreover, the local particle filter and the fusion particle filter are not synchronized. There are m iterative steps between them. Therefore, WACF (13) is used to reach consensus by outputs of local particle filter. If G ¯ is connected, then the outputs of the four weighted consensus filters will converge asymptotically to the weighted average consensus values. With the addition of a delayed update mechanism (DUM), WACF eliminates the asynchronous interference of the two filters.
The information of communication topology changes with time, such as the connection matrix, Laplace matrix, degree matrix, and weight matrix. The classical average consensus method is selected in CF/DPF. Compared with the classical method, WACF with time-varying weight matrix is more reasonable. The dynamic weight matrix effectively suppresses the influence of invalid nodes on the filtering results and improves the filtering accuracy. With the aid of DUM, the asynchronous problem caused by two filters in a series is also solved.

3.3. Algorithm Analysis

(1)
Analysis of TASD implementation steps.
The analysis of the TASD will described in this part and the pseudo code is in Algorithm 1. Firstly, the basic application background of the algorithm is briefly introduced.
The sparse and dynamic UWSN is composed of N n o d e nodes. The state vector x = x 1 , x 2 , . . . , x n x T is n x -dimensional. In most cases, n x = 4 and x = x 1 , x 2 , x 3 , x 4 T . The four-dimensional variables here represent the horizontal position coordinates, the longitudinal position coordinates, the transverse velocity, and the longitudinal velocity, respectively. At time k, node l ( 1 l N n o d e ) has a measurement z l k . Then, z = z 1 T , z 2 T , . . . , z N n o d e T T is the global observation vector. N L P F and N F P F represent the number of particles for the local particle filter and fusion particle filter, respectively. Moreover, the operation steps of the fusion particle filter are m steps slower than that of the local particle filter. Finally, node n at time k has the mean β n k and variance B n k of local filtering distribution. Similarly, it also has the mean γ n k and variance R n k of the local prediction distribution.
(2)
Computational complexity.
When improving the traditional scheme, if the complexity of the algorithm is blindly increased in order to pursue high location accuracy, it is not worth the loss. Therefore, the computational complexity of CF/DPF and TASD is simply compared in this paper. In the application field of target tracking, the internal computing equipment of observation nodes is generally implemented in the form of discrete recursion. Then the filtering calculation time becomes a crucial problem, which could be used to evaluate the efficiency of filtering algorithm. However, there are many factors that affect the actual calculation time of filtering, such as the performance of software used in the experimental operation, the configuration of the hardware equipment, communication factors, and programming methods. Therefore, it is difficult to have a uniform conclusion through strict theoretical proof. In this paper, floating point operations (Flops) in [36] are used to evaluate complexity computation. It contains floating-point multiplication, division, addition, and subtraction, but does not include logical operations.
Firstly, the computational complexity of CF/DPF is analyzed. The CF/DPF runs two complete particle filters, local particle filter, and fusion particle filter. Node l ( 1 l N n o d e ) has the computational complexity of the local particle filter as O N n o d e n x 2 N L P F ; the computational complexity of the fusion filter is O N n o d e n x 2 N L P F . The average consensus filter is inserted into the series structures of the two filters. Corollary 5.2 and Theorem 8.4 in [37] are cited, which are called Lemmas 5 and 6 in this paper.
Lemma 5.
Concerning the convergence time for the equal-neighbor, time-invariant, symmetric model on a connected graph on N n o d e nodes, its convergence time is defined as:
T N n o d e α   = O N n o d e 3 log N n o d e / α
Furthermore, for every positive integer N n o d e , there exists an N n o d e -node connected graph for which T N n o d e α   = Ω N n o d e 3 log 1 / α . According to the definition of O and Ω in [32], the CF/DPF’s computational complexity is obtained:
max N n o d e n x 2 N L P F + N F P F , n x 2 N n o d e 3 log 1 / α
Lemma 6.
There exists a connected graph on N n o d e nodes and a constant κ > 0 . The convergence time is defined as:
T N n o d e H , α   κ H N n o d e 3 log 1 / α
For connection topology G k =   V , ε k , V   = N n o d e , there exists iterative time series H and k; that G k =   V , ε k H ε k H + 1 · · · ε k + 1 H 1 is strongly connected. Moreover, (18) assumes that the topology is dynamic, so it is upper bound. The computational complexity of the TASD is:
max N n o d e n x 2 N L P F + N F P F , n x 2 H N n o d e 3 log 1 / α
From (17) and (19), it can be seen that the highest power of the expression of computational complexity is nearly the same, and the amount of computation does not change greatly.    
Algorithm 1: A tracking algorithm for sparse and dynamic underwater sensor networks
Input: X i ( l ) ( k + m 1 ) , W i ( l ) ( k + m 1 ) i = 1 N L P F particle set and weight set of the local particle filter.
Output: Estimation of global state x k + m .
Jmse 10 00337 i001

4. Simulation and Analysis

In order to facilitate the labeling expression for the subsequent simulation experiments, CF/DPF and TASD are used to represent the traditional multi-rate consensus/fusion filtering algorithm and the tracking algorithm for sparse and dynamic UWSNs, respectively. Before the simulation verification, it is necessary to illustrate and specify the main indices of performance. Firstly, several types of images are obtained by the simulation software, including comparisons of tracking trajectories, comparisons of errors, and comparisons of convergence rates. In order to verify the universality of TASD in practical application, two groups of simulation experimental environments are set up in this paper: Example 1 and Example 2, respectively. Compared with Example 1, Example 2 has more nodes, a larger monitoring range, sparser node distribution, and stronger dynamic characteristics of communication topology.
The average estimated error (AE) used to measure the accuracy of distributed estimation is defined:
A E k = 1 / N n o d e i = 1 N n o d e x ^ k i x k 2
The weighted average consensus tracking error (WE) is used to measure the convergence rate of the algorithm:
W E k = 1 / N n o d e i = 1 N n o d e x ^ k i x k , a v g 2
x ^ k i is the estimation of the state variable for node i 1 i N n o d e at time k. x k is the real state variable of the target. Moreover, x k , a v g is the weighted consensus state variable of the target.
How are the sparse and dynamic characteristics of the simulations reflected? Firstly, all communication links are not necessarily connected at each iteration step, and they change randomly with probability P. This reflects the dynamic characteristics. Secondly, if the communication radius R is small, then the number of neighbors of each node is small, too. The condition cannot satisfy the maximum number of communication connection sides. Moreover, some nodes have no neighboring nodes or some invalid nodes (no observation information) as a result of the limitation of sensing radius R 1 . This reflects the characteristics of sparse.
Example 1.
Small-scale sparse and dynamic UWSN.
The simulation scenario in Example 1 adopts the bearing-only tracking (BOT) model in [38], which is a non-linear model. Observations and prior knowledge are used to estimate state variable of four dimensions. The state variable at time k is x k   =   X k , Y k , X ˙ k , Y ˙ k . The system state model is described in (2). In this section, x k is replaced by x k and x k 1 is replaced by x k 1 . Then, the state function is given by:
f x k , k + 1   = 1 0 sin Φ k Δ T Φ k 1 cos Φ k Δ T Φ k 0 1 1 cos Φ k Δ T Φ k sin Φ k Δ T Φ k 0 0 cos Φ k Δ T sin Φ k Δ T 0 0 sin Φ k Δ T cos Φ k Δ T
With Φ k   = A m / X ˙ 2 k + 1 + Y ˙ 2 k + 1 . A m is called the acceleration parameter and set to 1.08 × 1 0 5 units / s 2 by [38].
The function of the observation is:
h n x k , k   =   atan X k X n / Y k Y n
The flicker noise in [39] is used as the observation noise. The likelihood model is described as:
P z n | x k   = ϑ × N x ; 0 , 10 4 σ ν n 2 k   +   1 ϑ   ×   N x ; 0 , σ ν n 2 k
where ϑ = 0.09 . The value of the noise variance σ ν n 2 depends on the distance r n k between the node n 1 n N n o d e and the target [40]:
σ ν n 2 k   = 0.08 r n 2 k   + 0.1150 r n k   + 0.7405
N n o d e = 50 sensor nodes are distributed in UWSN. The communication radius of each sensor node is R = 2 log N n o d e / N n o d e . The observation information can be exchanged among the nodes within the communication range for the compensation and adjustment of their own data. Moreover, each sensor node has a sensing radius R 1 = R , the node can observe and estimate the target’s position only with the target in the observation range. The position of the tracking target is initialized. It starts from position (3, 6), and the first three iterations are (2.9226, 5.8991), (2.8503, 5.7962), and (2.7673, 5.6855). The number of particles in the local particle filter is the same as that of the fusion particle filter, N L P F = N F P F = 500 .
The invalid nodes in each filtering step are counted. The statistical results are shown in Figure 3. It can be seen that the number of invalid nodes remains high. The least number of invalid nodes occurs between 60 to 70 iterations, However, the least number of invalid nodes accounts for a large proportion of total nodes. The observation results of these invalid nodes will lead to consensus errors; the accuracy of the final filtering result is low, and a divergent phenomenon occurs. If there is no limit, the maximum number of connected edges is M max = N n o d e ( N n o d e 1 ) / 2 = 1225 . In the simulations, the number of communication connection sides cannot reach the ideal maximum due to the limitation of communication distance and communication energy. The probability of an effective communication connection between any node n and 1 n N n o d e , 1 l N n o d e , n l in the communication range obeys the Bernoulli distribution, in that the neighboring nodes may be disconnected.
Figure 4 shows the target’s trajectory, CF/DPF and TASD’s tracking trajectory, as well as the tracking trajectory of an arbitrary observation node randomly selected. Each hollow circle represents an observation node, if there is a line between the two nodes, it means that the two observation nodes can communicate with each other. The maximum energy consumption E n can be calculated. The number of connecting edges is 56, M k M max . Therefore, if the undirected graph is connected, the UWSN formed in Figure 4 is a sparse and dynamic UWSN. The tracking trajectory of the CF/DPF fluctuates greatly around the true trajectory of the target and has a large deviation and divergence. This is because sparse and dynamic topology communication conditions affect CF/DPF. However, the trajectory of the TASD is smooth and has little fluctuation. The trajectory curve observed by a single node obviously deviates from the motion trajectory of the target, because the node may not be able to observe the target at every time. The observation trajectory divergence of the centralized particle filter algorithm (CPF) is obvious, which may be caused by the failure of the fusion center and failure of the dynamic adjustment of weight. The distributed unscented Kalman filter algorithm (DUKF) is similar to the CF/DPF algorithm. Their trajectories are roughly the same as those of the target, but the jitter is obvious. The tracking trajectory of TASD almost coincides with the real trajectory of the target. This is because TASD is suitable for sparse and dynamic UWSN. It can continuously and efficiently track the target. In contrast, TASD has the best tracking trajectory in sparse and dynamic UWSN.
In order to analyze the tracking accuracy of CF/DPF and TASD intuitively, the average estimation errors of the two algorithms will be compared. Figure 5 shows a comparison of the average estimation errors between CF/DPF and TASD. Abscissa is the iteration steps of the simulation, and ordinate is the error value. The average estimation errors of CF/DPF are between 0.05 to 1.35 m, and the amplitude of the curve is larger than that of the TASD. The curve does not show a uniform convergence trend, but tends to diverge. Because the traditional consensus scheme used by CF/DPF has no weight matrix adjustment, it does not take into account the different confidence of each node. The nodes with unreliable information are assigned the same weight as other nodes, so the cumulative estimation error is large. However, the average estimation error curve of TASD is gentler than that of CF/DPF. The fluctuation range of the curve is from 0 to 0.1 m and it tends to converge. The average estimation error of TASD is 92.6% lower than that of CF/DPF. This excellent error result is due to the WACF with DUM. WACF assigns different weights to different particles and nodes, and the weight matrix also changes with the change of dynamic topology. In this way, the content of reliable information accounts for a larger proportion, and the part of unreliable information is reduced or even ignored. Therefore, the final estimation result is more accurate. It is not difficult to see that our TASD has higher estimation accuracy than CF/DPF.
Figure 6 shows the weighted average consensus tracking error of CF/DPF and TASD. This comparison graph is used to reflect the convergence rate of the consensus algorithm. The fluctuation of the connecting points of the CF/DPF’s curve is obvious, and it also shows a large jump in the final convergence process. The curve of TASD is smoother than CF/DPF’s curve, and it converges faster than that of CF/DPF. The weighted consensus tracking error of TASD is reduced by 82.3% compared with CF/DPF. This is because TASD uses ARS to adjust the fusion particle filter. ARS improves the mean square convergence rate of WACF when considering the energy limitation of nodes. It can be seen that TASD has a faster and better mean square convergence rate than CF/DPF.
Example 2.
Large-scale sparse and dynamic UWSN.
According to the simulation environment of [38]. Equation (2) is used as the state model. Four dimensional state variables x k   =   X k , Y k , X ˙ k , Y ˙ k . The process noise Q = k w 2 × I 4 and k w = 4 . The observation model is:
z k n =   ρ k n φ k n   =   x k t x n 2 + y k t y n 2 arctan y k t y n / x k t x n   +   ν k n
where ρ k n and φ k n represent the distance and angle between the tracking target and the node n 1 n N n o d e at time k, 1 k , respectively. The covariance of observation noise is R k n = E v k n v k n T   = k v 2 × I 2 and k v = 2 .
The simulation environment is a large-scale sparse and dynamic UWSN. The number of nodes is N n o d e = 100 , and the area is expanded to 100 m × 100 m. The communication distance of these sensor nodes is set to R = N n o d e . The green solid line in Figure 7 is the true trajectory of the tracking target, the sampling time is 1s, and the total number of sampling steps is set to 200 here. The maximum number of communication connection edges between these sensor nodes is M max = N n o d e N n o d e 1 / 2 = 4950 . The number of connected edges in Figure 7 is 268. Moreover, whether the connected edges in the graph are connected must obey the assumptions in the previous paper. Then the background of this simulation experiment meets the requirements of large sparse and dynamic UWSN.
Figure 7 shows the comparison of tracking trajectories. The comparison includes CF/DPF, TASD, and an arbitrary node. The trajectory of CF/DPF jumps greatly and is not stable, the convergence trend is not obvious. Due to the limitation of observation distance, the observation trajectory of a single node deviates from the target trajectory more obviously. The trajectory of a centralized particle filter algorithm has obvious divergence, which is caused by the fusion center and invalid nodes. The tracking trajectory curve of distributed unscented Kalman filter is similar to that of CF/DPF. The tracking trajectory of TASD almost coincides with the true trajectory of the tracking target. The whole tracking trajectory is smooth without obvious jumping, and the convergence trend is obvious. When we merely look at the tracking trajectories, we can see that TASD has a better tracking ability than CF/DPF. The specific error situation needs further analysis to reach a conclusion.
The average estimation error is shown in Figure 8. It can be seen that the average estimation error curve of CF/DPF fluctuates between 0 and 30 m, with a large fluctuation range and has no obvious convergence trend. This is because CF/DPF does not have any regulation scheme and it is not suitable for sparse and dynamic UWSNs. The difference is, the average estimation error curve of TASD fluctuates from 0 to 3 m, the fluctuation amplitude is small, and the curve tends to converge to 0 m. The average estimation error of TASD is 90% lower than that of CF/DPF. This is because WACF regulates the weights of invalid nodes, which retains higher accuracy estimation results in the fusion process. Moreover, DUM compensates for the time difference between the filters. Therefore, the estimation accuracy of TASD is higher than CF/DPF.
Figure 9 presents the comparisons of weighted average consensus tracking errors. It can be seen that the weighted average consistent tracking error curve of CF/DPF fluctuates in the range of 0 to 90 m, with a large fluctuation range, and it has no convergence trend. The mean square convergence rate of the traditional consensus algorithm has not been optimized and can only converge by virtue of its own advantages. Therefore, the convergence error effect of CF/DPF is not ideal. Whereas the weighted average consensus tracking error curve of TASD fluctuates from 0 to 10 m, with a small fluctuation range, and is gentle. The weighted consensus tracking error of TASD is reduced by 88.9% compared with CF/DPF. This is not only due to the adoption of WACF, but also due to the addition of ARS. ARS maximizes the mean square convergence rate when the node energy is limited.

5. Conclusions

In a sparse and dynamic UWSN, the communication between nodes is unstable. Furthermore, in practical application, the system model is nonlinear and the noise is non-Gaussian. A tracking algorithm for sparse and dynamic UWSNs based on a particle filter is proposed. Two kinds of particle filters are run simultaneously on each sensor node. Firstly, the local particle filter uses the local observation information to estimate the state variable. It also transmits the filtering information to the next fusion filter. Then, in the fusion particle filter, the weighted average consensus filter is used to process the input information. Thus, the difference in reliability of state estimation among all nodes can be reasonably eliminated. Besides, the mean square convergence rate of the fusion filter is optimized under the condition of limited communication energy consumption. Finally, the global filtering results are output. In the future, the output of the fusion filter will be fed back to the local particle filter. Such a closed-loop feedback operation can modify the filtering result of the local particle filter and obtain a more accurate global state estimation result.

Author Contributions

Methodology, H.L., B.X. and B.L.; validation, H.L.and B.L.; writing—original draft preparation, H.L.and B.L.; writing—review and editing, H.L.and B.X.; supervision, H.L.and B.X. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Defense Science and Technology Foundation for Excellent Young Scientists of China, grant number 2020-JCJQ-ZQ-071.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Khasawneh, A.M.; Altalhi, M.; Kumar, A.; Aggarwal, G.; Kaiwartya, O.; Khalifeh, A.; Al-Khasawneh, M.A.; Alarood, A.A. An Efficient Void Aware Framework for Enabling Internet of Underwater Things. J. Mar. Sci. Eng. 2021, 9, 1219. [Google Scholar] [CrossRef]
  2. Alfouzan, F.A. Energy-Efficient Collision Avoidance MAC Protocols for Underwater Sensor Networks: Survey and Challenges. J. Mar. Sci. Eng. 2021, 9, 741. [Google Scholar] [CrossRef]
  3. Songzuo, L.; Iqbal, B.; Khan, I.U.; Ahmed, N.; Qiao, G.; Zhou, F. Full Duplex Physical and MAC Layer-Based Underwater Wireless Communication Systems and Protocols: Opportunities, Challenges, and Future Directions. J. Mar. Sci. Eng. 2021, 9, 468. [Google Scholar] [CrossRef]
  4. Xu, B.; Jiao, M.; Zhang, X.; Zhang, D. Path Tracking of an Underwater Snake Robot and Locomotion Efficiency Optimization Based on Improved Pigeon-Inspired Algorithm. J. Mar. Sci. Eng. 2022, 10, 47. [Google Scholar] [CrossRef]
  5. Li, D.L.; Du, L. AUV Trajectory Tracking Models and Control Strategies: A Review. J. Mar. Sci. Eng. 2021, 9, 1020. [Google Scholar] [CrossRef]
  6. Rego, F.; Pascoal, A.; Aguiar, A.P.; Jones, C. Distributed state estimation for discrete-time linear time invariant systems: A survey. Annu. Rev. Control 2019, 48, 36–56. [Google Scholar] [CrossRef]
  7. Battistelli, G.; Chisci, L. Stability of Consensus Extended Kalman Filtering for Distributed State Estimation. IFAC Proc. Vol. 2014, 47, 5520–5525. [Google Scholar] [CrossRef]
  8. Ghoreyshi, S.M.; Shahrabi, A.; Boutaleb, T. A Cluster-Based Mobile Data-Gathering Scheme for Underwater Sensor Networks. In Proceedings of the 2018 International Symposium on Networks, Computers and Communications (ISNCC), Rome, Italy, 19–21 June 2018; IEEE: New York, NY, USA, 2018. [Google Scholar]
  9. Ghoreyshi, S.M.; Shahrabi, A.; Boutaleb, T.; Khalily, M. Mobile Data Gathering With Hop-Constrained Clustering in Underwater Sensor Networks. IEEE Access 2019, 7, 21118–21132. [Google Scholar] [CrossRef]
  10. Xue, K.; Wu, T.Y. Distributed Consensus of USVs under Heterogeneous UAV-USV Multi-Agent Systems Cooperative Control Scheme. J. Mar. Sci. Eng. 2021, 9, 1314. [Google Scholar] [CrossRef]
  11. Schizas, I.D.; Ribeiro, A.; Giannakis, G.B. Consensus in ad hoc WSNs with noisy links—Part I: Distributed estimation of deterministic signals. IEEE Trans. Signal Process. 2008, 56, 350–364. [Google Scholar] [CrossRef]
  12. Schizas, I.D.; Giannakis, G.B.; Roumeliotis, S.I.; Ribeiro, A. Consensus in ad hoc WSNs with noisy links—Part II: Distributed estimation and smoothing of random signals. IEEE Trans. Signal Process. 2008, 56, 1650–1666. [Google Scholar] [CrossRef]
  13. Ghoreyshi, S.M.; Shahrabi, A.; Boutaleb, T. A Stateless Opportunistic Routing Protocol for Underwater Sensor Networks. Wirel. Commun. Mob. Comput. 2018, 2018, 8237351. [Google Scholar] [CrossRef]
  14. Ghoreyshi, S.M.; Shahrabi, A.; Boutaleb, T. An Efficient AUV-aided Data Collection in Underwater Sensor Networks. In Proceedings of the 32nd IEEE International Conference on Advanced Information Networking and Applications (AINA), Krakow, Poland, 16–18 May 2018; IEEE: New York, NY, USA, 2018; pp. 281–288. [Google Scholar] [CrossRef] [Green Version]
  15. Kamal, A.T.; Farrell, J.A.; Roy-Chowdhury, A.K. Information Weighted Consensus Filters and Their Application in Distributed Camera Networks. IEEE Trans. Autom. Control 2013, 58, 3112–3125. [Google Scholar] [CrossRef]
  16. Tang, W.J.; Zhang, G.L.; Zeng, J. Accelerated information weighted consensus-based DPF algorithm for target tracking in sparse wireless sensor networks. In Proceedings of the 34th Chinese Control Conference (CCC), Hangzhou, China, 28–30 July 2015; IEEE: New York, NY, USA, 2015; pp. 4529–4535. [Google Scholar]
  17. Kamal, A.T.; Ding, C.; Song, B.; Farrell, J.A.; Roy-Chowdhury, A.K. A Generalized Kalman Consensus Filter for Wide-Area Video Networks. In Proceedings of the 50th IEEE Conference of Decision and Control (CDC)/European Control Conference (ECC), Orlando, FL, USA, 12–15 December 2011; IEEE: New York, NY, USA, 2011; pp. 7863–7869. [Google Scholar]
  18. Tang, W.J.; Zhang, G.L.; Zeng, J.; Yue, Y.A. Information weighted consensus-based distributed particle filter for large-scale sparse wireless sensor networks. IET Commun. 2014, 8, 3113–3121. [Google Scholar] [CrossRef]
  19. Li, W.L.; Jia, Y.M.; Du, J.P. Distributed Kalman consensus filter with intermittent observations. J. Frankl. Inst. -Eng. Appl. Math. 2015, 352, 3764–3781. [Google Scholar] [CrossRef]
  20. Kim, D.Y.; Yoon, J.H.; Jeon, M.; Shin, V. Distributed information fusion with intermittent observations for large-scale sensor networks. Int. J. Innov. Comput. Inf. Control 2011, 7, 6437–6451. [Google Scholar]
  21. Chen, B.; Zhang, W.A.; Yu, L. Distributed Fusion Estimation With Missing Measurements, Random Transmission Delays and Packet Dropouts. IEEE Trans. Autom. Control 2014, 59, 1961–1967. [Google Scholar] [CrossRef]
  22. Zhou, Z.W.; Fang, H.T.; Hong, Y.G. Distributed Estimation for Moving Target Based on State-Consensus Strategy. IEEE Trans. Autom. Control 2013, 58, 2096–2101. [Google Scholar] [CrossRef]
  23. Zhu, F.Z.; Liu, X.; Peng, L. Adaptive consensus-based distributed H filtering with switching topology subject to partial information on transition probabilities. Appl. Math. Comput. 2021, 411, 17. [Google Scholar] [CrossRef]
  24. Han, F.; Dong, H.L.; Wang, Z.D.; Li, G.F. Local design of distributed H-consensus filtering over sensor networks under multiplicative noises and deception attacks. Int. J. Robust Nonlinear Control 2019, 29, 2296–2314. [Google Scholar] [CrossRef]
  25. Yu, H.Y.; Zhang, R.B.; Wu, J.W.; Li, X.W. Distributed Field Estimation Using Sensor Networks Based on H Consensus Filtering. Sensors 2018, 18, 3557. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Hlinka, O.; Hlawatsch, F.; Djuric, P.M. Distributed Sequential Estimation in Asynchronous Wireless Sensor Networks. IEEE Signal Process. Lett. 2015, 22, 1965–1969. [Google Scholar] [CrossRef]
  27. Mohammadi, A.; Asif, A. Distributed Consensus plus Innovation Particle Filtering for Bearing/Range Tracking with Communication Constraints. IEEE Trans. Signal Process. 2015, 63, 620–635. [Google Scholar] [CrossRef]
  28. Mohammadi, A.; Asif, A. Distributed Particle Filter Implementation with Intermittent/Irregular Consensus Convergence. IEEE Trans. Signal Process. 2013, 61, 2572–2587. [Google Scholar] [CrossRef] [Green Version]
  29. Olfati-Saber, R. Kalman-Consensus Filter: Optimality, Stability, and Performance. In Proceedings of the Joint 48th IEEE Conference on Decision and Control (CDC)/28th Chinese Control Conference (CCC), Shanghai, China, 15–18 December 2009; IEEE: New York, NY, USA, 2009; pp. 7036–7042. [Google Scholar] [CrossRef]
  30. Ojha, T.; Misra, S.; Obaidat, M.S. SEAL: Self-adaptive AUV-based localization for sparsely deployed Underwater Sensor Networks. Comput. Commun. 2020, 154, 204–215. [Google Scholar] [CrossRef]
  31. Misra, S.; Ojha, T.; Mondal, A. Game-Theoretic Topology Control for Opportunistic Localization in Sparse Underwater Sensor Networks. IEEE Trans. Mob. Comput. 2015, 14, 990–1003. [Google Scholar] [CrossRef]
  32. Rajasekaran, L.; Santhanam, S.M. Optimum frequency selection for localization of underwater AUV using dynamic positioning parameters. Microsyst. Technol. -Micro Nanosyst. -Inf. Storage Process. Syst. 2021, 27, 4291–4303. [Google Scholar] [CrossRef]
  33. Kar, S.; Moura, J.M.F. Distributed average consensus in sensor networks with random link failures. In Proceedings of the 32nd IEEE International Conference on Acoustics, Speech and Signal Processing, Honolulu, HI, USA, 15–20 April 2007; IEEE: New York, NY, USA, 2007; p. 1013. [Google Scholar]
  34. Kar, S.; Moura, J.M.F. Sensor networks with random links: Topology design for distributed consensus. IEEE Trans. Signal Process. 2008, 56, 3315–3326. [Google Scholar] [CrossRef] [Green Version]
  35. Li, X.X.; Chen, M.Z.Q.; Su, H.S.; Li, C.Y. Consensus networks with switching topology and time-delays over finite fields. Automatica 2016, 68, 39–43. [Google Scholar] [CrossRef]
  36. Karlsson, R.; Schon, T.; Gustafsson, F. Complexity analysis of the marginalized particle filter. IEEE Trans. Signal Process. 2005, 53, 4408–4411. [Google Scholar] [CrossRef] [Green Version]
  37. Olshevsky, A.; Tsitsiklis, J.N. Convergence Speed in Distributed Consensus and Averaging. Siam Rev. 2011, 53, 747–772. [Google Scholar] [CrossRef] [Green Version]
  38. Arulampalam, M.S.; Ristic, B.; Gordon, N.; Mansell, T. Bearings-only tracking of manoeuvring targets using particle filters. Eurasip J. Appl. Signal Process. 2004, 2004, 2351–2365. [Google Scholar] [CrossRef] [Green Version]
  39. Li, X.R.; Jilkov, V.P. Survey of maneuvering target tracking. Part I: Dynamic models. IEEE Trans. Aerosp. Electron. Syst. 2003, 39, 1333–1364. [Google Scholar] [CrossRef]
  40. Li, X.; Ercan, M.F. Decentralized Coordination Control for a Network of Mobile Robotic Sensors. Wirel. Pers. Commun. 2018, 102, 2429–2442. [Google Scholar] [CrossRef]
Figure 1. Tracking trajectory of CF/DPF. (a) Tracking trajectory in a dense network. (b) Tracking trajectory in a sparse and dynamic network.
Figure 1. Tracking trajectory of CF/DPF. (a) Tracking trajectory in a dense network. (b) Tracking trajectory in a sparse and dynamic network.
Jmse 10 00337 g001
Figure 2. TASD.
Figure 2. TASD.
Jmse 10 00337 g002
Figure 3. The number of invalid nodes.
Figure 3. The number of invalid nodes.
Jmse 10 00337 g003
Figure 4. Tracking trajectory.
Figure 4. Tracking trajectory.
Jmse 10 00337 g004
Figure 5. Average estimation errors.
Figure 5. Average estimation errors.
Jmse 10 00337 g005
Figure 6. Weighted consensus tracking errors.
Figure 6. Weighted consensus tracking errors.
Jmse 10 00337 g006
Figure 7. Tracking trajectory.
Figure 7. Tracking trajectory.
Jmse 10 00337 g007
Figure 8. Average estimation errors in a large-scale sparse and dynamic UWSN.
Figure 8. Average estimation errors in a large-scale sparse and dynamic UWSN.
Jmse 10 00337 g008
Figure 9. Weighted consensus tracking errors in a large-scale sparse and dynamic UWSN.
Figure 9. Weighted consensus tracking errors in a large-scale sparse and dynamic UWSN.
Jmse 10 00337 g009
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Liu, H.; Xu, B.; Liu, B. A Tracking Algorithm for Sparse and Dynamic Underwater Sensor Networks. J. Mar. Sci. Eng. 2022, 10, 337. https://doi.org/10.3390/jmse10030337

AMA Style

Liu H, Xu B, Liu B. A Tracking Algorithm for Sparse and Dynamic Underwater Sensor Networks. Journal of Marine Science and Engineering. 2022; 10(3):337. https://doi.org/10.3390/jmse10030337

Chicago/Turabian Style

Liu, Haiming, Bo Xu, and Bin Liu. 2022. "A Tracking Algorithm for Sparse and Dynamic Underwater Sensor Networks" Journal of Marine Science and Engineering 10, no. 3: 337. https://doi.org/10.3390/jmse10030337

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop