Networked Fusion Filtering from Outputs with Stochastic Uncertainties and Correlated Random Transmission Delays

Abstract

This paper is concerned with the distributed and centralized fusion filtering problems in sensor networked systems with random one-step delays in transmissions. The delays are described by Bernoulli variables correlated at consecutive sampling times, with different characteristics at each sensor. The measured outputs are subject to uncertainties modeled by random parameter matrices, thus providing a unified framework to describe a wide variety of network-induced phenomena; moreover, the additive noises are assumed to be one-step autocorrelated and cross-correlated. Under these conditions, without requiring the knowledge of the signal evolution model, but using only the first and second order moments of the processes involved in the observation model, recursive algorithms for the optimal linear distributed and centralized filters under the least-squares criterion are derived by an innovation approach. Firstly, local estimators based on the measurements received from each sensor are obtained and, after that, the distributed fusion filter is generated as the least-squares matrix-weighted linear combination of the local estimators. Also, a recursive algorithm for the optimal linear centralized filter is proposed. In order to compare the estimators performance, recursive formulas for the error covariance matrices are derived in all the algorithms. The effects of the delays in the filters accuracy are analyzed in a numerical example which also illustrates how some usual network-induced uncertainties can be dealt with using the current observation model described by random matrices.

1. Introduction

Estimation problems in networked stochastic systems have been widely studied, especially in the past decade, due to the wide range of potential applications in many areas, such as target tracking, air traffic control, fault diagnosis, computer vision, and so on, and important advances in the design of multisensor fusion techniques have been achieved [1]. The basic question in the fusion estimation problems is how to merge the measurement data of different sensors; usually, the centralized and distributed fusion methods are used. Centralized fusion estimators are obtained by processing in the fusion center the measurements received from all sensors; in the distributed fusion method, first, local estimators, based on the measurements received from each sensor, are obtained and, then, these local estimators are combined according to a certain information fusion criterion. Several centralized and/or distributed fusion estimation algorithms have been proposed for conventional systems (see, e.g., [2,3,4,5], and the references therein), where the sensor measured outputs are affected only by additive noises, and assuming that the data are sent directly to the fusion center without any kind of transmission error; that is, assuming perfect connections.

However, although the use of sensor networks offers several advantages, due to restrictions of the physical equipment and uncertainties in the external environment, new problems associated with network-induced phenomena inevitably arise in both the output and the transmission of the sensor measurements [6]. Multiplicative noise uncertainties, sensor gain degradations and missing measurements are some of the random phenomena that usually arise in the sensor measured outputs, which cannot only be described by the usual additive disturbances. The existence of these uncertainties can severely degrade the performance of the conventional estimators, and has encouraged the need of designing new fusion estimation algorithms for such systems (see, e.g., [7,8,9,10,11], and references therein). Clearly, these situations with uncertainties in the measurements of the network sensors can be modeled by systems with random parameter measurement matrices, which have important practical significance due to the large number of realistic situations and application areas, such as digital control of chemical processes, radar control, navigation systems, or economic systems, in which this kind of systems with stochastic parameters are found (see, e.g., [12,13], among others). Therefore, it is not surprising that, in the past few years, much attention has been focused on the design of new fusion estimation algorithms for systems with random parameter matrices (see, e.g., [14,15,16,17], and references therein).

In addition to the aforementioned uncertainties, when the data packets are sent from the sensors to the processing center via a communication network, some further network-induced phenomena, such as random delays or measurement loss, inevitably arise during this transmission process, due to the unreliable network characteristics, imperfect communication channels and failures in the transmission. These additional transmission uncertainties can spoil the fusion estimators performance and motivate the need of designing fusion estimation algorithms that take their effects into consideration. In recent years, in response to the popularity of networked stochastic systems, the fusion estimation problem from observations with random delays and packet dropouts, which may happen during the data transmission, has been one of the mainstream research topics (see, e.g., [18,19,20,21,22,23,24,25,26,27,28,29,30], and references therein). All the above papers on signal estimation with random transmission delays assume independent random delays in each sensor and mutually independent delays between the different network sensors; in [31] this restriction was weakened and random delays featuring correlation at consecutive sampling times were considered, thus allowing to deal with common practical situations (e.g., those in which two consecutive observations cannot be delayed).

It should also be noted that in many real-world problems the measurement noises are usually correlated; for example, when all the sensors operate in the same noisy environment or when the sensor noises are state dependent. For this reason, the fairly conservative assumption that the measurement noises are uncorrelated is commonly weakened in most of the aforementioned research on signal estimation, including systems with both deterministic and random parameter matrices. Namely, the optimal Kalman filtering fusion problem in systems with cross-correlated noises at consecutive sampling times is addressed, for example, in [25]; also, under different types of noise correlation, centralized and distributed fusion algorithms are obtained in [11,26] for systems with multiplicative noise, and in [7] for systems where the measurements might have partial information about the signal. Autocorrelated and cross-correlated noises have been also considered in systems with random parameter matrices and transmission uncertainties; some results on the fusion estimation problems in these systems can be found in [22,24,27].

In this paper, covariance information is used to address the distributed and centralized fusion estimation problems for a class of linear networked stochastic systems with measured outputs perturbed by random parameter matrices, and subject to one-step random transmission delays. It is assumed that the sensor measurement noises are one-step autocorrelated and cross-correlated, and that the Bernoulli variables describing the measurement delays in the different sensors are correlated at the same and consecutive sampling times. The proposed observation model can describe the case of one-step delay, packet loss, or re-received measurements. To the best of the authors’ knowledge, fusion estimation problems in this framework with random measurement matrices and cross-correlated sensor noises in the measured outputs, together with correlated random delays in transmission, has not been investigated; so, encouraged by the above considerations, we reckon that it constitutes an interesting research challenge.

The main contributions of the current research are highlighted as follows: (i) The treatment used to address the estimation problem, based on covariance information, does not require the evolution model generating the signal process; nonetheless, the proposed fusion algorithms are also applicable to the conventional state-space model formulation; (ii) Random parameter matrices are considered in the measured outputs, which provide a fairly comprehensive and unified framework to describe some network-induced phenomena, such as multiplicative noise uncertainties or missing measurements, and correlation between the different sensor measurement noises is simultaneously considered; (iii) As in [31], random correlated delays in the transmission, with different delay characteristics at each sensor, are considered; however, the observation model in this paper is more general than that in [31], as the latter does not take random measurement matrices and correlated noises into account; (iv) Unlike [22,24,31], where only centralized fusion estimators are obtained, in this paper, both centralized and distributed estimation problems are addressed; the estimators are obtained under the innovation approach and recursive algorithms, very simple computationally and suitable for online applications, are proposed; (v) Finally, it must be noted that we do not use the augmented approach to deal with the delayed measurements, thus reducing the computational cost compared with the augmentation method.

The rest of the paper is organized as follows. Both, the measurement outputs with random parameter matrices, and the one-step random delay observation models are presented in Section 2, including the model hypotheses under which the distributed and centralized estimation problems are addressed. The distributed fusion method is applied in Section 3; specifically, the local least-squares linear filtering algorithms are derived in Section 3.1 using an innovation approach and, in Section 3.2, the proposed distributed fusion filter is obtained by a matrix-weighted linear combination of the local filtering estimators, using the mean squared error as optimality criterion. In Section 4, a recursive algorithm for the centralized least-squares linear filtering estimator is proposed. Section 5 is devoted to analyze the effectiveness of the proposed estimation algorithms by a simulation example, in which the effects of the sensor random delays on the estimators are compared. Some conclusions are drawn in Section 6.

Notation: 

The notations throughout the paper are standard. The notation $a\wedge b$ indicates the minimum value of two real numbers $a,b$. ${\mathbb{R}}^n$ and ${\mathbb{R}}^{m\times n}$ denote the n-dimensional Euclidean space and the set of all $m\times n$ real matrices, respectively. For a matrix A, the symbols $A^T$ and $A^{-1}$ denote its transpose and inverse, respectively; the notation $A\otimes B$ represents the Kronecker product of the matrices $A,B$. If the dimensions of vectors or matrices are not explicitly stated, they are assumed to be compatible with algebraic operations. In particular, I and 0 denote the identity matrix and the zero matrix of appropriate dimensions, respectively. For any function $G_{k,s}$, depending on the time instants k and s, we will write $G_k=G_{k,k}$ for simplicity; analogously, $F^{\left(i\right)}=F^{\left(ii\right)}$ will be written for any function $F^{\left(ij\right)}$, depending on the sensors i and j. Finally, ${\delta }_{k,s}$ denotes the Kronecker delta function.

2. Problem Formulation and Model Description

This paper deals with the distributed and centralized fusion filtering problems from randomly delayed observations coming from networked sensors; the signal measurements at the different sensors are noisy linear functions with random parameter matrices, and the sensor noises are assumed to be correlated and cross-correlated at the same and consecutive sampling times. The estimation is performed in a processing center, which is connected to all sensors, where the measurements are transmitted through unreliable communication channels which may lead to one-step random delays, due to network congestion or other causes. In the centralized filtering problem, the estimators are obtained by fusion of all the network observations at each sampling time, whereas in the distributed filtering, local estimators, based only on the observations of each individual sensor, are first obtained and then, a fusion estimator based on the local ones is calculated.

Our aim is to design recursive algorithms for the optimal linear distributed and centralized filters under the least-squares (LS) criterion, requiring only the first and second-order moments of the processes involved in the model describing the observations from the different sensors. Next, we present the model and formulate the hypotheses necessary to address the estimation problem.

Description of the observation model. Let us consider a discrete-time second-order $n_x$-dimensional signal process, $\{x_k;k\ge 1\}$, which is measured in m sensor nodes of the network, $i=1,\dots ,m$, that generate the outputs $z_k^{\left(i\right)}\in {\mathbb{R}}^{n_z},k\ge 1$, described by

$$z_k^{\left(i\right)}=H_k^{\left(i\right)}{x}_k+v_k^{\left(i\right)},k\ge 1;i=1,\dots ,m$$

(1)

where $\{H_k^{\left(i\right)};k\ge 1\}$ are independent random parameter matrices of appropriate dimensions and $\{v_k^{\left(i\right)};k\ge 1\}$ is the process describing the measurement noise in sensor i, which is assumed to be one-step correlated. We also assume that all the sensors operate in the same noisy environment and there exists correlation between different sensor noises at the same and consecutive sampling times.

In order to estimate the signal process, $\{x_k;k\ge 1\}$, the measurement outputs are transmitted to a processing center via unreliable channels, causing one-step random delays in such transmissions. When a measurement, $z_k^{\left(i\right)}$, suffers delay and, hence, it is unavailable at time k, the processor is assumed to use the previous one, $z_{k-1}^{\left(i\right)}$; this way of dealing with delays requires that the first measurement is always available and so, considering zero-one random variables ${\gamma }_k^{\left(i\right)},k\ge 2$, the observations used in the estimation are described by

$$y_k^{\left(i\right)}=(1-{\gamma }_k^{\left(i\right)})z_k^{\left(i\right)}+{\gamma }_k^{\left(i\right)}{z}_{k-1}^{\left(i\right)},k\ge 2;y_1^{\left(i\right)}=z_1^{\left(i\right)};i=1,\dots ,m$$

(2)

In this paper, the variables modelling the delays are assumed to be one-step correlated, thus covering many practical situations; for example those in which two consecutive observations through the same channel cannot be delayed, and situations where there is some sort of link between the different communications channels.

Model hypotheses. The LS estimation problem will be addressed under the following hypotheses about the processes involved in Equations (1) and (2), which formally specify the above assumptions:

(H1) 

The signal process, $\left\{x_k;k\ge 1\right\}$, has zero mean and its covariance function can be expressed in a separable form; namely, $E\left[x_k{x}_s^T\right]=A_k{B}_s^T,s\le k$, where $A_k,B_k,k\ge 1,$ are known matrices of dimensions $n_x\times N$.

(H2) 

$\left\{H_k^{\left(i\right)};k\ge 1\right\}$, $i=1,\dots ,m$, are independent sequences of independent random parameter matrices whose entries have known means and known second-order moments; we will denote ${\overline{H}}_k^{\left(i\right)}\equiv E[H_k^{\left(i\right)}],k\ge 1$.

(H3) 

The sensor measurement noises $\left\{v_k^{\left(i\right)};k\ge 1\right\},i=1,\dots ,m$, are zero-mean sequences with known second-order moments, defined by:

$$E\left[v_k^{\left(i\right)}{v}_s^{\left(j\right)T}\right]=R_k^{\left(ij\right)}{\delta }_{k,s}+R_{k,k-1}^{\left(ij\right)}{\delta }_{k-1,s},s\le k;i,j=1,\dots ,m$$

(H4) 

$\left\{{\gamma }_k^{\left(i\right)};k\ge 2\right\},i=1,\dots ,m,$ are sequences of Bernoulli random variables with known means, ${\overline{\gamma }}_k^{\left(i\right)}\equiv E\left[{\gamma }_k^{\left(i\right)}\right],k\ge 2$. It is assumed that ${\gamma }_k^{\left(i\right)}$ and ${\gamma }_s^{\left(j\right)}$ are independent for $|k-s|\ge 2$, and the second-order moments, ${\overline{\gamma }}_{k,s}^{\left(ij\right)}\equiv E\left[{\gamma }_k^{\left(i\right)}{\gamma }_s^{\left(j\right)}\right],s=k-1,k,$ and $i,j=1,\dots ,m,$ are also known.

(H5) 

For $i=1,\dots ,m$, the processes $\{x_k;k\ge 1\},\{H_k^{\left(i\right)};k\ge 1\},\{v_k^{\left(i\right)};k\ge 1\}$ and $\left\{{\gamma }_k^{\left(i\right)};k\ge 2\right\}$ are mutually independent.

Hypotheses (H1)–(H5) guarantee that the observation processes in the different sensors have zero mean, and that the matrices ${\Sigma }_{k,s}^{y^{\left(ij\right)}}\equiv E\left[y_k^{\left(i\right)}{y}_s^{\left(j\right)T}\right],s=k-1,k$, can be obtained from ${\Sigma }_{k,s}^{z^{\left(ij\right)}}\equiv E\left[z_k^{\left(i\right)}{z}_s^{\left(j\right)T}\right],s=k-2,k-1,k$, and their transposes, by the following expressions:

$$\begin{array}{c}{\Sigma }_{k,s}^{y^{\left(ij\right)}}=\left(1-{\overline{\gamma }}_k^{\left(i\right)}-{\overline{\gamma }}_s^{\left(j\right)}+{\overline{\gamma }}_{k,s}^{\left(ij\right)}\right){\Sigma }_{k,s}^{z^{\left(ij\right)}}+\left({\overline{\gamma }}_s^{\left(j\right)}-{\overline{\gamma }}_{k,s}^{\left(ij\right)}\right){\Sigma }_{k,s-1}^{z^{\left(ij\right)}}+\left({\overline{\gamma }}_k^{\left(i\right)}-{\overline{\gamma }}_{k,s}^{\left(ij\right)}\right){\Sigma }_{k-1,s}^{z^{\left(ij\right)}}+\hfill \\ \phantom{{\Sigma }_{k,s}^{y^{\left(ij\right)}}=}+{\overline{\gamma }}_{k,s}^{\left(ij\right)}{\Sigma }_{k-1,s-1}^{z^{\left(ij\right)}},k,s\ge 2\hfill \\ {\Sigma }_{2,1}^{y^{\left(ij\right)}}=\left(1-{\overline{\gamma }}_2^{\left(i\right)}\right){\Sigma }_{2,1}^{z^{\left(ij\right)}}+{\overline{\gamma }}_2^{\left(i\right)}{\Sigma }_1^{z^{\left(ij\right)}};{\Sigma }_1^{y^{\left(ij\right)}}={\Sigma }_1^{z^{\left(ij\right)}}\hfill \\ {\Sigma }_{k,s}^{z^{\left(ij\right)}}=E\left[H_k^{\left(i\right)}{A}_k{B}_s^T{H}_s^{\left(j\right)T}\right]+R_k^{\left(ij\right)}{\delta }_{k,s}+R_{k,k-1}^{\left(ij\right)}{\delta }_{k-1,s},s\le k\hfill \end{array}$$

(3)

Remark 1. 

The term $E\left[H_k^{\left(i\right)}{A}_k{B}_s^T{H}_s^{\left(j\right)T}\right]$ in ${\Sigma }_{k,s}^{z^{\left(ij\right)}}$ becomes from $E\left[H_k^{\left(i\right)}{x}_k{x}_s^T{H}_s^{\left(j\right)T}\right]$ which, from the independence between $(x_k,x_s)$ and $(H_k^{\left(i\right)},H_s^{\left(j\right)})$, is equal to $E\left[H_k^{\left(i\right)}E\left[x_k{x}_s^T\right]H_s^{\left(j\right)T}\right]$. From (H2), $E\left[H_k^{\left(i\right)}{A}_k{B}_s^T{H}_s^{\left(j\right)T}\right]={\overline{H}}_k^{\left(i\right)}{A}_k{B}_s^T{\overline{H}}_s^{\left(j\right)T}$ for $j\ne i$ or $s\ne k$, and $E\left[H_k^{\left(i\right)}{A}_k{B}_k^T{H}_k^{\left(i\right)T}\right]$ is computed from its entries, according the following formula:

$${\left(E\left[H{A}_k{B}_k^{T}H\right]\right)}_{pq}=\sum _{a=1}^{n_x}\sum _{b=1}^{n_x}E\left[h_{pa}{h}_{qb}\right]{\left(A_k{B}_k^T\right)}_{ab},p,q=1,\dots ,n_z$$

where $H\in {\mathbb{R}}^{n_z\times n_x}$ is any random matrix and $h_{pq}$ denote its entries.

3. Distributed Fusion Linear Filter

The aim of this section is to address the distributed fusion linear filtering problem of the signal $x_k$, from the randomly delayed observations defined by Equations (1) and (2), under the LS criterion. The proposed distributed filter is designed as the LS matrix-weighted linear combination of the local LS linear filters and therefore, in a first step, such local filters need being derived.

3.1. Derivation of the Local LS Linear Filters

With the purpose of obtaining the signal LS linear filters based on the available observations from each sensor, we will use an innovation approach, which provides recursive algorithms for the local estimators, that will be denoted by ${\widehat{x}}_{k/k}^{\left(i\right)},i=1,\dots ,m$.

For each sensor $i=1,\dots ,m$, the innovation at time k, which represents the new information provided by the k-th observation, is defined by ${\mu }_k^{\left(i\right)}=y_k^{\left(i\right)}-{\widehat{y}}_{k/k-1}^{\left(i\right)},k\ge 1$, where ${\widehat{y}}_{k/k-1}^{\left(i\right)}$ is the LS linear estimator of $y_k$ based on $y_s^{\left(i\right)},s\le k-1$, with ${\widehat{y}}_{1/0}^{\left(i\right)}=E\left[y_1^{\left(i\right)}\right]=0$. As it is known [32], the innovations, $\{{\mu }_k^{\left(i\right)};k\ge 1\}$, constitute a zero-mean white process, and the LS linear estimator of any random vector ${\xi }_k$ based on the observations $y_1^{\left(i\right)},\dots ,y_L^{\left(i\right)}$, denoted by ${\widehat{\xi }}_{k/L}^{\left(i\right)}$, can be calculated as a linear combination of the corresponding innovations, ${\mu }_1^{\left(i\right)},\dots {\mu }_L^{\left(i\right)}$; namely,

$${\widehat{\xi }}_{k/L}^{\left(i\right)}=\sum _{h=1}^{L}E\left[{\xi }_k{\mu }_h^{\left(i\right)T}\right]{\Pi }_h^{\left(i\right)-1}{\mu }_h^{\left(i\right)}$$

(4)

where ${\Pi }_k^{\left(i\right)}\equiv E\left[{\mu }_k^{\left(i\right)}{\mu }_k^{\left(i\right)T}\right]$ denotes the covariance matrix of ${\mu }_k^{\left(i\right)}$. This general expression is derived from the Orthogonal Projection Lemma (OPL), which establishes that the estimation error is uncorrelated with all the observations or, equivalently, uncorrelated with all the innovations.

Using the following alternative expression for the observations $y_k^{\left(i\right)}$ given by Equation (2),

$$\begin{array}{c}{y}_k^{\left(i\right)}=\left(1-{\overline{\gamma }}_k^{\left(i\right)}\right)H_k^{\left(i\right)}{x}_k+{\overline{\gamma }}_k^{\left(i\right)}{\overline{H}}_{k-1}^{\left(i\right)}{x}_{k-1}+w_k^{\left(i\right)},k\ge 2\hfill \\ w_k^{\left(i\right)}={\overline{\gamma }}_k^{\left(i\right)}\left(H_{k-1}^{\left(i\right)}-{\overline{H}}_{k-1}^{\left(i\right)}\right)x_{k-1}+\left(1-{\overline{\gamma }}_k^{\left(i\right)}\right)v_k^{\left(i\right)}+{\overline{\gamma }}_k^{\left(i\right)}{v}_{k-1}^{\left(i\right)}-\left({\gamma }_k^{\left(i\right)}-{\overline{\gamma }}_k^{\left(i\right)}\right)\left(z_k^{\left(i\right)}-z_{k-1}^{\left(i\right)}\right),k\ge 2\hfill \end{array}$$

(5)

and taking into account the independence hypotheses stated on the model, it is easy to see, from Equation (4), that

$${\widehat{y}}_{k/k-1}^{\left(i\right)}=\left(1-{\overline{\gamma }}_k^{\left(i\right)}\right){\overline{H}}_k^{\left(i\right)}{\widehat{x}}_{k/k-1}^{\left(i\right)}+{\overline{\gamma }}_k^{\left(i\right)}{\overline{H}}_{k-1}^{\left(i\right)}{\widehat{x}}_{k-1/k-1}^{\left(i\right)}+\sum _{h=1}^{(k-1)\wedge 2}{\mathcal{W}}_{k,k-h}^{\left(i\right)}{\Pi }_{k-h}^{\left(i\right)-1}{\mu }_{k-h}^{\left(i\right)},k\ge 2$$

(6)

where ${\mathcal{W}}_{k,k-h}^{\left(i\right)}\equiv E\left[w_k^{\left(i\right)}{\mu }_{k-h}^{\left(i\right)T}\right],h=1,2.$

The general Expression (4) for the LS linear estimators as linear combination of the innovations, together with Expression (6) for the one-stage observation predictor, are the starting point to derive the local recursive filtering algorithms presented below in Theorem 1; these algorithms provide also the filtering error covariance matrices, $P_{k/k}^{\left(i\right)}\equiv E\left[(x_k-{\widehat{x}}_{k/k}^{\left(i\right)}){(x_k-{\widehat{x}}_{k/k}^{\left(i\right)})}^T\right]$, which measure the accuracy of the estimators ${\widehat{x}}_{k/k}^{\left(i\right)}$ when the LS optimality criterion is used.

Hereafter, for the matrices $A_k$ and $B_k$ involved in the signal covariance factorization (H1), the following operator will be used:

$${\overline{\mathcal{H}}}_{C_k}^{\left(i\right)}=\left(1-{\overline{\gamma }}_k^{\left(i\right)}\right){\overline{H}}_k^{\left(i\right)}{C}_k+{\overline{\gamma }}_k^{\left(i\right)}{\overline{H}}_{k-1}^{\left(i\right)}{C}_{k-1},k\ge 2;{\overline{\mathcal{H}}}_{C_1}^{\left(i\right)}={\overline{H}}_1^{\left(i\right)}{C}_1,C=A,B$$

(7)

Theorem 1. 

For each $i=1,\dots ,m$, the local LS linear filters, ${\widehat{x}}_{k/k}^{\left(i\right)},$ and the corresponding error covariance matrices, $P_{k/k}^{\left(i\right)}$, are given by

$$\begin{array}{c}{\widehat{x}}_{k/k}^{\left(i\right)}=A_k{O}_k^{\left(i\right)},k\ge 1\hfill \end{array}$$

(8)

and

$$P_{k/k}^{\left(i\right)}=A_k{\left(B_k-A_k{r}_k^{\left(i\right)}\right)}^T,k\ge 1$$

(9)

where the vectors $O_k^{\left(i\right)}$ and the matrices $r_k^{\left(i\right)}=E\left[O_k^{\left(i\right)}{O}_k^{\left(i\right)T}\right]$ are recursively obtained from

$$O_k^{\left(i\right)}=O_{k-1}^{\left(i\right)}+J_k^{\left(i\right)}{\Pi }_k^{\left(i\right)-1}{\mu }_k^{\left(i\right)},k\ge 1;O_0^{\left(i\right)}=0$$

(10)

$$r_k^{\left(i\right)}=r_{k-1}^{\left(i\right)}+J_k^{\left(i\right)}{\Pi }_k^{\left(i\right)-1}{J}_k^{\left(i\right)T},k\ge 1;r_0^{\left(i\right)}=0$$

(11)

and the matrices $J_k^{\left(i\right)}=E\left[O_k^{\left(i\right)}{\mu }_k^{\left(i\right)T}\right]$ satisfy

$$J_k^{\left(i\right)}={\overline{\mathcal{H}}}_{B_k}^{\left(i\right)T}-r_{k-1}^{\left(i\right)}{\overline{\mathcal{H}}}_{A_k}^{\left(i\right)T}-\sum _{h=1}^{(k-1)\wedge 2}{J}_{k-h}^{\left(i\right)}{\Pi }_{k-h}^{\left(i\right)-1}{\mathcal{W}}_{k,k-h}^{\left(i\right)T},k\ge 2;J_1^{\left(i\right)}={\overline{\mathcal{H}}}_{B_1}^{\left(i\right)T}$$

(12)

The innovations ${\mu }_k^{\left(i\right)}$, and their covariance matrices, ${\Pi }_k^{\left(i\right)}$, are given by

$${\mu }_k^{\left(i\right)}=y_k^{\left(i\right)}-{\overline{\mathcal{H}}}_{A_k}^{\left(i\right)}{O}_{k-1}^{\left(i\right)}-\sum _{h=1}^{(k-1)\wedge 2}{\mathcal{W}}_{k,k-h}^{\left(i\right)}{\Pi }_{k-h}^{\left(i\right)-1}{\mu }_{k-h}^{\left(i\right)},k\ge 2;{\mu }_1^{\left(i\right)}=y_1^{\left(i\right)}$$

(13)

and

$$\begin{array}{c}{\displaystyle {\Pi }_k^{\left(i\right)}={\Sigma }_k^{y^{\left(i\right)}}-{\overline{\mathcal{H}}}_{A_k}^{\left(i\right)}\left({\overline{\mathcal{H}}}_{B_k}^{\left(i\right)T}-J_k^{\left(i\right)}\right)-\sum _{h=1}^{(k-1)\wedge 2}{\mathcal{W}}_{k,k-h}^{\left(i\right)}{\Pi }_{k-h}^{\left(i\right)-1}{\left({\overline{\mathcal{H}}}_{A_k}^{\left(i\right)}{J}_{k-h}^{\left(i\right)}+{\mathcal{W}}_{k,k-h}^{\left(i\right)}\right)}^T,k\ge 2}\hfill \\ {\Pi }_1^{\left(i\right)}={\Sigma }_1^{y^{\left(i\right)}}\hfill \end{array}$$

(14)

The coefficients ${\mathcal{W}}_{k,k-h}^{\left(i\right)}=E\left[w_k^{\left(i\right)}{\mu }_{k-h}^{\left(i\right)T}\right]$, $h=1,2$, are calculated as

$$\begin{array}{c}{\mathcal{W}}_{k,k-1}^{\left(i\right)}={\Sigma }_{k,k-1}^{y^{\left(i\right)}}-{\overline{\mathcal{H}}}_{A_k}^{\left(i\right)}{\overline{\mathcal{H}}}_{B_{k-1}}^{\left(i\right)T}-{\mathcal{W}}_{k,k-2}^{\left(i\right)}{\Pi }_{k-2}^{\left(i\right)-1}{\left({\overline{\mathcal{H}}}_{A_{k-1}}^{\left(i\right)}{J}_{k-2}^{\left(i\right)}+{\mathcal{W}}_{k-1,k-2}^{\left(i\right)}\right)}^T,k\ge 3\hfill \\ {\mathcal{W}}_{2,1}^{\left(i\right)}={\Sigma }_{2,1}^{y^{\left(i\right)}}-{\overline{\mathcal{H}}}_{A_2}^{\left(i\right)}{\overline{\mathcal{H}}}_{B_1}^{\left(i\right)T}\hfill \end{array}$$

(15)

$${\mathcal{W}}_{k,k-2}^{\left(i\right)}={\overline{\gamma }}_k^{\left(i\right)}(1-{\overline{\gamma }}_{k-2}^{\left(i\right)})R_{k-1,k-2}^{\left(i\right)},k\ge 4;{\mathcal{W}}_{3,1}^{\left(i\right)}={\overline{\gamma }}_3^{\left(i\right)}{R}_{2,1}^{\left(i\right)}$$

(16)

Finally, the matrices ${\Sigma }_{k,s}^{y^{\left(i\right)}}$ and ${\overline{\mathcal{H}}}_{A_s}^{\left(i\right)},{\overline{\mathcal{H}}}_{B_s}^{\left(i\right)},s=k-1,k$, are given in Equations (3) and (7), respectively.

Proof of Theorem 1. 

The local filter ${\widehat{x}}_{k/k}^{\left(i\right)}$ will be obtained from the general Expression (4), starting from the computation of the coefficients ${\mathcal{X}}_{k,h}^{\left(i\right)}=E\left[x_k{\mu }_h^{\left(i\right)T}\right]=E\left[x_k{y}_h^{\left(i\right)T}\right]-E\left[x_k{\widehat{y}}_{h/h-1}^{\left(i\right)T}\right],1\le h\le k$.

The independence hypotheses and the separable structure of the signal covariance (H1) lead to $E\left[x_k{y}_h^{\left(i\right)T}\right]=A_k{\overline{\mathcal{H}}}_{B_h}^{\left(i\right)T}$, with ${\overline{\mathcal{H}}}_{B_h}^{\left(i\right)}$ given by Equation (7). From Expression (6) for ${\widehat{y}}_{h/h-1}^{\left(i\right)},h\ge 2,$ we have:

$$E\left[x_k{\widehat{y}}_{h/h-1}^{\left(i\right)T}\right]=\left(1-{\overline{\gamma }}_h^{\left(i\right)}\right)E\left[x_k{\widehat{x}}_{h/h-1}^{\left(i\right)T}\right]{\overline{H}}_h^{\left(i\right)T}+{\overline{\gamma }}_h^{\left(i\right)}E\left[x_k{\widehat{x}}_{h-1/h-1}^{\left(i\right)T}\right]{\overline{H}}_{h-1}^{\left(i\right)T}+\sum _{j=1}^{(h-1)\wedge 2}{\mathcal{X}}_{k,h-j}^{\left(i\right)}{\Pi }_{h-j}^{\left(i\right)-1}{\mathcal{W}}_{h,h-j}^{\left(i\right)T}$$

Hence, using now Equation (4) for ${\widehat{x}}_{h/h-1}^{\left(i\right)}$ and ${\widehat{x}}_{h-1/h-1}^{\left(i\right)}$, the filter coefficients are expressed as

$$\begin{array}{c}{\displaystyle {\mathcal{X}}_{k,h}^{\left(i\right)}=A_k{\overline{\mathcal{H}}}_{B_h}^{\left(i\right)T}-\sum _{j=1}^{h-1}{\mathcal{X}}_{k,j}^{\left(i\right)}{\Pi }_j^{\left(i\right)-1}\left(\left(1-{\overline{\gamma }}_h^{\left(i\right)}\right){\mathcal{X}}_{h,j}^{\left(i\right)T}{\overline{H}}_h^{\left(i\right)T}+{\overline{\gamma }}_h^{\left(i\right)}{\mathcal{X}}_{h-1,j}^{\left(i\right)T}{\overline{H}}_{h-1}^{\left(i\right)T}\right)}\hfill \\ {\displaystyle \phantom{{\mathcal{X}}_{k,h}^{\left(i\right)}=}-\sum _{j=1}^{(h-1)\wedge 2}{\mathcal{X}}_{k,h-j}^{\left(i\right)}{\Pi }_{h-j}^{\left(i\right)-1}{\mathcal{W}}_{h,h-j}^{\left(i\right)T},2\le h\le k;}\hfill \\ {\mathcal{X}}_{k,1}^{\left(i\right)}=A_k{\overline{\mathcal{H}}}_{B_1}^{\left(i\right)T}\hfill \end{array}$$

which guarantees that ${\mathcal{X}}_{k,h}^{\left(i\right)}=A_k{J}_h^{\left(i\right)},1\le h\le k$, with $J_h^{\left(i\right)}$ given by

$${\displaystyle J_h^{\left(i\right)}={\overline{\mathcal{H}}}_{B_h}^{\left(i\right)T}-\sum _{j=1}^{h-1}{J}_j^{\left(i\right)}{\Pi }_j^{\left(i\right)-1}{J}_j^{\left(i\right)T}{\overline{\mathcal{H}}}_{A_h}^{\left(i\right)T}-\sum _{j=1}^{(h-1)\wedge 2}{J}_{h-j}^{\left(i\right)}{\Pi }_{h-j}^{\left(i\right)-1}{\mathcal{W}}_{h,h-j}^{\left(i\right)T},h\ge 2;J_1^{\left(i\right)}={\overline{\mathcal{H}}}_{B_1}^{\left(i\right)T}}$$

(17)

Therefore, by defining ${\displaystyle O_k^{\left(i\right)}=\sum _{h=1}^k{J}_h^{\left(i\right)}{\Pi }_h^{\left(i\right)-1}{\mu }_h^{\left(i\right)}}$ and $r_k^{\left(i\right)}=E\left[O_k^{\left(i\right)}{O}_k^{\left(i\right)T}\right]$, Expression (8) for the filter follows immediately from Equation (4), and Equation (9) is obtained by using the OPL to express $P_{k/k}^{\left(i\right)}=E\left[x_k{x}_k^T\right]-E\left[{\widehat{x}}_{k/k}^{\left(i\right)}{\widehat{x}}_{k/k}^{\left(i\right)T}\right]$, and applying (H1) and Equation (8).

The recursive Expressions (10) and (11) are directly obtained from the corresponding definitions, taking into account that ${\displaystyle r_k^{\left(i\right)}=\sum _{h=1}^k{J}_h^{\left(i\right)}{\Pi }_h^{\left(i\right)-1}{J}_h^{\left(i\right)T}}$ which, in turn, from Equation (17), leads to Equation (12) for $J_k^{\left(i\right)}$.

From now on, using that ${\widehat{x}}_{k/k-1}^{\left(i\right)}=A_k{O}_{k-1}^{\left(i\right)},{\widehat{x}}_{k-1/k-1}^{\left(i\right)}=A_{k-1}{O}_{k-1}^{\left(i\right)}$ and Equation (7), Expression (6) for the observation predictor will be equivalently written as follows:

$${\displaystyle {\widehat{y}}_{k/k-1}^{\left(i\right)}={\overline{\mathcal{H}}}_{A_k}^{\left(i\right)}{O}_{k-1}^{\left(i\right)}+\sum _{h=1}^{(k-1)\wedge 2}{\mathcal{W}}_{k,k-h}^{\left(i\right)}{\Pi }_{k-h}^{\left(i\right)-1}{\mu }_{k-h}^{\left(i\right)},k\ge 2}$$

(18)

From Equation (18), Expression (13) for the innovation is directly obtained and, applying the OPL to express its covariance matrix as ${\Pi }_k^{\left(i\right)}=E\left[y_k^{\left(i\right)}{y}_k^{\left(i\right)T}\right]-E\left[{\widehat{y}}_{k/k-1}^{\left(i\right)}{\widehat{y}}_{k/k-1}^{\left(i\right)T}\right]$, the following identity holds:

$${\Pi }_k^{\left(i\right)}={\Sigma }_k^{y^{\left(i\right)}}-{\overline{\mathcal{H}}}_{A_k}^{\left(i\right)}E\left[O_{k-1}^{\left(i\right)}{\widehat{y}}_{k/k-1}^{\left(i\right)T}\right]-\sum _{h=1}^{(k-1)\wedge 2}{\mathcal{W}}_{k,k-h}^{\left(i\right)}{\Pi }_{k-h}^{\left(i\right)-1}E\left[{\mu }_{k-h}^{\left(i\right)}{\widehat{y}}_{k/k-1}^{\left(i\right)T}\right],k\ge 2;{\Pi }_1^{\left(i\right)}={\Sigma }_1^{y^{\left(i\right)}}$$

Now, using again Equation (18), it is deduced from Expression (12) that $E\left[O_{k-1}^{\left(i\right)}{\widehat{y}}_{k/k-1}^{\left(i\right)T}\right]={\overline{\mathcal{H}}}_{B_k}^{\left(i\right)T}-J_k^{\left(i\right)}$ and, since $E\left[{\widehat{y}}_{k/k-1}^{\left(i\right)}{\mu }_{k-h}^{\left(i\right)T}\right]={\overline{\mathcal{H}}}_{A_k}^{\left(i\right)}E\left[O_{k-1}^{\left(i\right)}{\mu }_{k-h}^{\left(i\right)T}\right]+{\mathcal{W}}_{k,k-h}^{\left(i\right)}$ and $E\left[O_{k-1}^{\left(i\right)}{\mu }_{k-h}^{\left(i\right)T}\right]=J_{k-h}^{\left(i\right)},h=1,2$, Expression (14) for ${\Pi }_k^{\left(i\right)}$ is obtained.

To complete the proof, the expressions for ${\mathcal{W}}_{k,k-h}^{\left(i\right)}=E\left[w_k^{\left(i\right)}{\mu }_{k-h}^{\left(i\right)T}\right],h=1,2$, with $w_k^{\left(i\right)}$ given in Equation (5), are derived taking into account that $w_k^{\left(i\right)}$ is uncorrelated with $y_h^{\left(i\right)},h\le k-3$. Consequently, ${\mathcal{W}}_{k,k-2}^{\left(i\right)}=E\left[w_k^{\left(i\right)}{y}_{k-2}^{\left(i\right)T}\right]$, and Expression (16) is directly obtained from Equations (1), (2) and (5), using the hypotheses stated on the model. Next, using Equation (4) for ${\widehat{y}}_{k-1/k-2}^{\left(i\right)}$ in ${\mathcal{W}}_{k,k-1}^{\left(i\right)}=E\left[w_k^{\left(i\right)}{y}_{k-1}^{\left(i\right)T}\right]-E\left[w_k^{\left(i\right)}{\widehat{y}}_{k-1/k-2}^{\left(i\right)T}\right]$, we have:

$${\mathcal{W}}_{k,k-1}^{\left(i\right)}=E\left[w_k^{\left(i\right)}{y}_{k-1}^{\left(i\right)T}\right]-{\mathcal{W}}_{k,k-2}^{\left(i\right)}{\Pi }_{k-2}^{\left(i\right)-1}{\left(E\left[y_{k-1}^{\left(i\right)}{\mu }_{k-2}^{\left(i\right)T}\right]\right)}^T$$

(19)

To compute the first expectation involved in this formula, we express $w_k^{\left(i\right)}=y_k^{\left(i\right)}-(1-{\overline{\gamma }}_k^{\left(i\right)})H_k^{\left(i\right)}{x}_k-{\overline{\gamma }}_k^{\left(i\right)}{H}_{k-1}^{\left(i\right)}{x}_{k-1}$ and we apply the OPL to rewrite $E\left[x_s{y}_{k-1}^{\left(i\right)T}\right]=E\left[{\widehat{x}}_{s/k-1}^{\left(i\right)}{y}_{k-1}^{\left(i\right)T}\right],s=k,k-1$, thus obtaining that $E\left[w_k^{\left(i\right)}{y}_{k-1}^{\left(i\right)T}\right]={\Sigma }_{k,k-1}^{y^{\left(i\right)}}-{\overline{\mathcal{H}}}_{A_k}^{\left(i\right)}E\left[O_{k-1}^{\left(i\right)}{y}_{k-1}^{\left(i\right)T}\right]$; then, by expressing $E\left[O_{k-1}^{\left(i\right)}{y}_{k-1}^{\left(i\right)T}\right]=E\left[O_{k-1}^{\left(i\right)}{\mu }_{k-1}^{\left(i\right)T}\right]+E\left[O_{k-1}^{\left(i\right)}{\widehat{y}}_{k/k-1}^{\left(i\right)T}\right]$ and using Equations (12) and (18), it follows that $E\left[w_k^{\left(i\right)}{y}_{k-1}^{\left(i\right)T}\right]={\Sigma }_{k,k-1}^{y^{\left(i\right)}}-{\overline{\mathcal{H}}}_{A_k}^{\left(i\right)}{\overline{\mathcal{H}}}_{B_{k-1}}^{\left(i\right)T}.$ The second expectation in Equation (19) is easily computed taking into account that, from the OPL, it is equal to $E\left[{\widehat{y}}_{k-1/k-2}^{\left(i\right)}{\mu }_{k-2}^{\left(i\right)T}\right]$ and using Equation (18). So the proof is completed. ☐

3.2. Derivation of the Distributed LS Fusion Linear Filter

As it has been mentioned previously, a linear matrix-weighted fusion filter is now generated from the local filters by applying the LS optimality criterion. The distributed fusion filter at any time k is hence designed as a product, ${\mathcal{F}}_k{\widehat{X}}_{k/k}$, where ${\widehat{X}}_{k/k}={\left({\widehat{x}}_{k/k}^{\left(1\right)T},\dots ,{\widehat{x}}_{k/k}^{\left(m\right)T}\right)}^T$ is the vector constituted by the local filters, and ${\mathcal{F}}_k\in {\mathbb{R}}^{n_x\times m{n}_x}$ is a matrix such that the mean squared error, $E\left[{\left(x_k-{\mathcal{F}}_k{\widehat{X}}_{k/k}\right)}^T\left(x_k-{\mathcal{F}}_k{\widehat{X}}_{k/k}\right)\right]$, is minimized.

As it is known, the solution of this problem is given by ${\mathcal{F}}_k^{opt}=E\left[x_k{\widehat{X}}_{k/k}^T\right]{\left(E\left[{\widehat{X}}_{k/k}{\widehat{X}}_{k/k}^T\right]\right)}^{-1}$ and, consequently, the proposed distributed filter is expressed as:

$${\widehat{x}}_{k/k}^{\left(D\right)}=E\left[x_k{\widehat{X}}_{k/k}^T\right]{\widehat{\Sigma }}_{k/k}^{-1}{\widehat{X}}_{k/k}$$

(20)

with ${\widehat{\Sigma }}_{k/k}\equiv E\left[{\widehat{X}}_{k/k}{\widehat{X}}_{k/k}^T\right]={\left(E\left[{\widehat{x}}_{k/k}^{\left(i\right)}{\widehat{x}}_{k/k}^{\left(j\right)T}\right]\right)}_{i,j=1,\dots ,m}$.

In view of Equation (20), and since the OPL guarantees that $E\left[x_k{\widehat{X}}_{k/k}^T\right]=\left(E\left[{\widehat{x}}_{k/k}^{\left(1\right)}{\widehat{x}}_{k/k}^{\left(1\right)T}\right],\dots ,E\left[{\widehat{x}}_{k/k}^{\left(m\right)}{\widehat{x}}_{k/k}^{\left(m\right)T}\right]\right)$, the derivation of ${\widehat{x}}_{k/k}^{\left(D\right)}$ only requires the knowledge of the matrices ${\widehat{\Sigma }}_{k/k}^{\left(ij\right)}\equiv E\left[{\widehat{x}}_{k/k}^{\left(i\right)}{\widehat{x}}_{k/k}^{\left(j\right)T}\right],i,j=1,\dots ,m$.

The following theorem provides a recursive algorithm to compute the matrices ${\widehat{\Sigma }}_{k/k}^{\left(ij\right)}$ which not only determine the proposed distributed fusion filter, but also the filtering error covariance matrix, $P_{k/k}^{\left(D\right)}=E\left[\left(x_k-{\widehat{x}}_{k/k}^{\left(D\right)}\right){\left(x_k-{\widehat{x}}_{k/k}^{\left(D\right)}\right)}^T\right]$.

Theorem 2. 

Let ${\widehat{X}}_{k/k}={\left({\widehat{x}}_{k/k}^{\left(1\right)T},\dots ,{\widehat{x}}_{k/k}^{\left(m\right)T}\right)}^T$ denote the vector constituted by the local LS filters given in Theorem 1, and ${\widehat{\Sigma }}_{k/k}={\left({\widehat{\Sigma }}_{k/k}^{\left(ij\right)}\right)}_{i,j=1,\dots ,m}$ , with ${\widehat{\Sigma }}_{k/k}^{\left(ij\right)}=E\left[{\widehat{x}}_{k/k}^{\left(i\right)}{\widehat{x}}_{k/k}^{\left(j\right)T}\right]$. Then, the distributed filtering estimator, ${\widehat{x}}_{k/k}^{\left(D\right)}$, and the error covariance matrix, $P_{k/k}^{\left(D\right)}$, are given by

$${\widehat{x}}_{k/k}^{\left(D\right)}=\left({\widehat{\Sigma }}_{k/k}^{\left(1\right)},\dots ,{\widehat{\Sigma }}_{k/k}^{\left(m\right)}\right){\widehat{\Sigma }}_{k/k}^{-1}{\widehat{X}}_{k/k},k\ge 1$$

(21)

and

$$P_{k/k}^{\left(D\right)}=A_k{B}_k^T-\left({\widehat{\Sigma }}_{k/k}^{\left(1\right)},\dots ,{\widehat{\Sigma }}_{k/k}^{\left(m\right)}\right){\widehat{\Sigma }}_{k/k}^{-1}{\left({\widehat{\Sigma }}_{k/k}^{\left(1\right)},\dots ,{\widehat{\Sigma }}_{k/k}^{\left(m\right)}\right)}^T,k\ge 1$$

(22)

The matrices ${\widehat{\Sigma }}_{k/k}^{\left(ij\right)}$, $i,j=1,\dots ,m$, are computed by

$${\widehat{\Sigma }}_{k/k}^{\left(ij\right)}=A_k{r}_k^{\left(ij\right)}{A}_k^T,k\ge 1$$

(23)

with $r_k^{\left(ij\right)}=E\left[O_k^{\left(i\right)}{O}_k^{\left(j\right)T}\right]$ satisfying

$$r_k^{\left(ij\right)}=r_{k-1}^{\left(ij\right)}+J_{k-1,k}^{\left(ij\right)}{\Pi }_k^{\left(j\right)-1}{J}_k^{\left(j\right)T}+J_k^{\left(i\right)}{\Pi }_k^{\left(i\right)-1}{J}_k^{\left(ji\right)T},k\ge 1;r_0^{\left(ij\right)}=0$$

(24)

where $J_{k-1,k}^{\left(ij\right)}=E\left[O_{k-1}^{\left(i\right)}{\mu }_k^{\left(j\right)T}\right]$ are given by

$$\begin{array}{c}{\displaystyle J_{k-1,k}^{\left(ij\right)}=\left(r_{k-1}^{\left(i\right)}-r_{k-1}^{\left(ij\right)}\right){\overline{\mathcal{H}}}_{A_k}^{\left(j\right)T}+\sum _{h=1}^{(k-1)\wedge 2}{J}_{k-h}^{\left(i\right)}{\Pi }_{k-h}^{\left(i\right)-1}{\mathcal{W}}_{k,k-h}^{\left(ji\right)T}-\sum _{h=1}^{(k-1)\wedge 2}{J}_{k-1,k-h}^{\left(ij\right)}{\Pi }_{k-h}^{\left(j\right)-1}{\mathcal{W}}_{k,k-h}^{\left(j\right)T},k\ge 2}\hfill \\ J_{0,1}^{\left(ij\right)}=0\hfill \end{array}$$

(25)

and $J_{k,s}^{\left(ij\right)}=E\left[O_k^{\left(i\right)}{\mu }_s^{\left(j\right)T}\right],$ for $s=k-1,k$, satisfy

$$J_{k,s}^{\left(ij\right)}=J_{k-1,s}^{\left(ij\right)}+J_k^{\left(i\right)}{\Pi }_k^{\left(i\right)-1}{\Pi }_{k,s}^{\left(ij\right)},k\ge 2;J_1^{\left(ij\right)}=J_1^{\left(i\right)}{\Pi }_1^{\left(i\right)-1}{\Pi }_1^{\left(ij\right)}$$

(26)

The innovation cross-covariance matrices ${\Pi }_k^{\left(ij\right)}=E\left[{\mu }_k^{\left(i\right)}{\mu }_k^{\left(j\right)T}\right]$ are obtained from

$$\begin{array}{c}{\Pi }_k^{\left(ij\right)}={\Sigma }_k^{y^{\left(ij\right)}}-{\overline{\mathcal{H}}}_{A_k}^{\left(i\right)}\left({\overline{\mathcal{H}}}_{B_k}^{\left(j\right)T}-J_k^{\left(j\right)}-J_{k-1,k}^{\left(ij\right)}\right)\hfill \\ {\displaystyle \phantom{{\Pi }_k^{\left(ij\right)}=}-\sum _{h=1}^{(k-1)\wedge 2}{\mathcal{W}}_{k,k-h}^{\left(ij\right)}{\Pi }_{k-h}^{\left(j\right)-1}{\left({\overline{\mathcal{H}}}_{A_k}^{\left(j\right)}{J}_{k-h}^{\left(j\right)}+{\mathcal{W}}_{k,k-h}^{\left(j\right)}\right)}^T-\sum _{h=1}^{(k-1)\wedge 2}{\mathcal{W}}_{k,k-h}^{\left(i\right)}{\Pi }_{k-h}^{\left(i\right)-1}{\Pi }_{k-h,k}^{\left(ij\right)},k\ge 2}\hfill \\ {\Pi }_1^{\left(ij\right)}={\Sigma }_1^{y^{\left(ij\right)}}\hfill \end{array}$$

(27)

where ${\Pi }_{k,s}^{\left(ij\right)}=E\left[{\mu }_k^{\left(i\right)}{\mu }_s^{\left(j\right)T}\right],s=k-2,k-1$, are given by

$${\displaystyle {\Pi }_{k,s}^{\left(ij\right)}={\overline{\mathcal{H}}}_{A_k}^{\left(i\right)}\left(J_s^{\left(j\right)}-J_{k-1,s}^{\left(ij\right)}\right)+{\mathcal{W}}_{k,s}^{\left(ij\right)}-\sum _{h=1}^{(k-1)\wedge 2}{\mathcal{W}}_{k,k-h}^{\left(i\right)}{\Pi }_{k-h}^{\left(i\right)-1}{\Pi }_{k-h,s}^{\left(ij\right)},k\ge 2}$$

(28)

The coefficients ${\mathcal{W}}_{k,k-h}^{\left(ij\right)}=E\left[w_k^{\left(i\right)}{\mu }_{k-h}^{\left(j\right)T}\right],h=1,2$, involved in the above expressions, are computed by

$$\begin{array}{c}{\mathcal{W}}_{k,k-1}^{\left(ij\right)}={\Sigma }_{k,k-1}^{y^{\left(ij\right)}}-{\overline{\mathcal{H}}}_{A_k}^{\left(i\right)}{\overline{\mathcal{H}}}_{B_{k-1}}^{\left(j\right)T}-{\mathcal{W}}_{k,k-2}^{\left(ij\right)}{\Pi }_{k-2}^{\left(j\right)-1}{\left({\overline{\mathcal{H}}}_{A_{k-1}}^{\left(j\right)}{J}_{k-2}^{\left(j\right)}+{\mathcal{W}}_{k-1,k-2}^{\left(j\right)}\right)}^T,k\ge 3\hfill \\ {\mathcal{W}}_{3,2}^{\left(ij\right)}={\Sigma }_{2,1}^{y^{\left(ij\right)}}-{\overline{\mathcal{H}}}_{A_2}^{\left(i\right)}{\overline{\mathcal{H}}}_{B_1}^{\left(j\right)T}\hfill \end{array}$$

(29)

$${\mathcal{W}}_{k,k-2}^{\left(ij\right)}={\overline{\gamma }}_k^{\left(i\right)}\left(1-{\overline{\gamma }}_{k-2}^{\left(j\right)}\right)R_{k-1,k-2}^{\left(ij\right)},k\ge 4;{\mathcal{W}}_{3,1}^{\left(ij\right)}={\overline{\gamma }}_3^{\left(i\right)}{R}_{2,1}^{\left(ij\right)}$$

(30)

Finally, the matrices ${\Sigma }_{k,s}^{y^{\left(ij\right)}}$, and ${\overline{\mathcal{H}}}_{A_s}^{\left(l\right)},{\overline{\mathcal{H}}}_{B_s}^{\left(l\right)},s=k-1,k,l=i,j$, are given in Equations (3) and (7), respectively.

Proof. 

As it has been discussed previously, Expression (21) is immediately derived from Equation (20), while Equation (22) is obtained from $P_{k/k}^{\left(D\right)}=E\left[x_k{x}_k^T\right]-E\left[{\widehat{x}}_{k/k}^{\left(D\right)}{\widehat{x}}_{k/k}^{\left(D\right)T}\right]$, using (H1) and (21). Moreover, Equation (23) for ${\widehat{\Sigma }}_{k/k}^{\left(ij\right)}$ is directly obtained using Equation (8) for the local filters and defining $r_k^{\left(ij\right)}=E\left[O_k^{\left(i\right)}{O}_k^{\left(j\right)T}\right]$.

Next, we derive the recursive formulas to obtain the matrices $r_k^{\left(ij\right)}$, which clearly satisfy Equation (24) by simply using Equation (10) and defining $J_{s,k}^{\left(ij\right)}=E\left[O_s^{\left(i\right)}{\mu }_k^{\left(j\right)T}\right],s=k-1,k$.

For subsequent derivations, the following expression of the one-stage predictor of $y_k^{\left(j\right)}$ based on the observations of sensor i will be used; this expression is obtained from Equation (5), taking into account, as proven in Theorem 1, that ${\widehat{x}}_{k/s}^{\left(i\right)}=A_k{O}_s^{\left(i\right)},s=k-1,k$, and defining ${\mathcal{W}}_{k,k-h}^{\left(ji\right)}=E\left[w_k^{\left(j\right)}{\mu }_{k-h}^{\left(i\right)T}\right],h=1,2$:

$${\displaystyle {\widehat{y}}_{k/k-1}^{(j/i)}={\overline{\mathcal{H}}}_{A_k}^{\left(j\right)}{O}_{k-1}^{\left(i\right)}+\sum _{h=1}^{(k-1)\wedge 2}{\mathcal{W}}_{k,k-h}^{\left(ji\right)}{\Pi }_{k-h}^{\left(i\right)-1}{\mu }_{k-h}^{\left(i\right)},k\ge 2}$$

(31)

As Expression (31) is a generalization of Equation (18), hereafter we will also refer to it for the local predictors ${\widehat{y}}_{k/k-1}^{\left(i\right)},k\ge 2$.

By applying the OPL, is clear that $E\left[O_{k-1}^{\left(i\right)}{y}_k^{\left(j\right)T}\right]=E\left[O_{k-1}^{\left(i\right)}{\widehat{y}}_{k/k-1}^{(j/i)T}\right]$ and, consequently, we can rewrite $J_{k-1,k}^{\left(ij\right)}=E\left[O_{k-1}^{\left(i\right)}{\left({\widehat{y}}_{k/k-1}^{(j/i)}-{\widehat{y}}_{k/k-1}^{\left(j\right)}\right)}^T\right]$; then, using Equation (31) for both predictors, Expression (25) is easily obtained. Also, Equation (26) for $J_{k,s}^{\left(ij\right)},s=k-1,k$, is immediate from Equation (10), by simply defining ${\Pi }_{k,s}^{\left(ij\right)}=E\left[{\mu }_k^{\left(i\right)}{\mu }_s^{\left(j\right)T}\right]$.

To obtain Equation (27), firstly we apply the OPL to express ${\Pi }_k^{\left(ij\right)}={\Sigma }_k^{y^{\left(ij\right)}}-E\left[{\widehat{y}}_{k/k-1}^{(i/j)}{\widehat{y}}_{k/k-1}^{\left(j\right)T}\right]-E\left[{\widehat{y}}_{k/k-1}^{\left(i\right)}{\mu }_k^{\left(j\right)T}\right]$. Then, using Equation (31) for ${\widehat{y}}_{k/k-1}^{(i/j)}$ and ${\widehat{y}}_{k/k-1}^{\left(i\right)}$, and definitions of $J_{k-1,k}^{\left(ij\right)}$ and ${\Pi }_{k-h,k}^{\left(ij\right)}$, we have

$$\begin{array}{c}{\displaystyle E\left[{\widehat{y}}_{k/k-1}^{(i/j)}{\widehat{y}}_{k/k-1}^{\left(j\right)T}\right]={\overline{\mathcal{H}}}_{A_k}^{\left(i\right)}E\left[O_{k-1}^{\left(j\right)}{\widehat{y}}_{k/k-1}^{\left(j\right)T}\right]+\sum _{h=1}^{(k-1)\wedge 2}{\mathcal{W}}_{k,k-h}^{\left(ij\right)}{\Pi }_{k-h}^{\left(j\right)-1}E\left[{\mu }_{k-h}^{\left(j\right)}{\widehat{y}}_{k/k-1}^{\left(j\right)T}\right],}\hfill \\ {\displaystyle E\left[{\widehat{y}}_{k/k-1}^{\left(i\right)}{\mu }_k^{\left(j\right)T}\right]={\overline{\mathcal{H}}}_{A_k}^{\left(i\right)}{J}_{k-1,k}^{\left(ij\right)}+\sum _{h=1}^{(k-1)\wedge 2}{\mathcal{W}}_{k,k-h}^{\left(i\right)}{\Pi }_{k-h}^{\left(i\right)-1}{\Pi }_{k-h,k}^{\left(ij\right)}}\hfill \end{array}$$

and Equation (27) is obtained taking into account that $E\left[O_{k-1}^{\left(j\right)}{\widehat{y}}_{k/k-1}^{\left(j\right)T}\right]={\overline{\mathcal{H}}}_{B_k}^{\left(j\right)T}-J_k^{\left(j\right)}$ and $E\left[{\widehat{y}}_{k/k-1}^{\left(j\right)}{\mu }_{k-h}^{\left(j\right)T}\right]={\overline{\mathcal{H}}}_{A_k}^{\left(j\right)}{J}_{k-h}^{\left(j\right)}+{\mathcal{W}}_{k,k-h}^{\left(j\right)}$, as it has been derived in the proof of Theorem 1.

Next, Expression (28) for ${\Pi }_{k,s}^{\left(ij\right)}=E\left[y_k^{\left(i\right)}{\mu }_s^{\left(j\right)T}\right]-E\left[{\widehat{y}}_{k/k-1}^{\left(i\right)}{\mu }_s^{\left(j\right)T}\right],$ with $s=k-2,k-1$, is obtained from $E\left[y_k^{\left(i\right)}{\mu }_s^{\left(j\right)T}\right]={\mathcal{H}}_{A_k}^{\left(i\right)}{J}_s^{\left(j\right)}+{\mathcal{W}}_{k,s}^{\left(ij\right)}$, and using Equation (31) in $E\left[{\widehat{y}}_{k/k-1}^{\left(i\right)}{\mu }_s^{\left(j\right)T}\right]$.

Finally, the reasoning for obtaining the coefficients ${\mathcal{W}}_{k,k-h}^{\left(ij\right)}=E\left[w_k^{\left(i\right)}{\mu }_{k-h}^{\left(j\right)T}\right],h=1,2,$ is also similar to that of ${\mathcal{W}}_{k,k-h}^{\left(i\right)}$ in Theorem 1, so it is omitted. Then the proof of Theorem 2 is completed. ☐

4. Centralized LS Fusion Linear Filter

In the centralized fusion filtering, the observations of the different sensors are jointly processed at each sampling time to yield the optimal filter of the signal $x_k$, which will be denoted by ${\widehat{x}}_{k/k}^{\left(C\right)}$. To carry out this process, at each time $k\ge 1$ we will work with the vector constituted by the observations of all sensors, $y_k={\left(y_k^{\left(1\right)T},\dots y_k^{\left(m\right)T}\right)}^T$, which, from Equation (2), can be expressed by

$$y_k=\left(I-{\Gamma }_k\right)z_k+{\Gamma }_k{z}_{k-1},k\ge 2;y_1=z_1$$

(32)

where $z_k={\left(z_k^{\left(1\right)T},\dots z_k^{\left(m\right)T}\right)}^T$ is the vector constituted by the sensor measured outputs given in Equation (1), and ${\Gamma }_k=Diag\left({\gamma }_k^{\left(1\right)},\dots ,{\gamma }_k^{\left(m\right)}\right)\otimes I_{n_z}$. Let us note that, analogously to the sensor measured outputs $z_k^{\left(i\right)}$, the stacked vector $z_k$ is a noisy linear function of the signal, with random parameter matrices defined by $H_k={\left(H_k^{\left(1\right)T},\dots H_k^{\left(m\right)T}\right)}^T$, and noise $v_k={\left(v_k^{\left(1\right)T},\dots v_k^{\left(m\right)T}\right)}^T$:

$$z_k=H_k{x}_k+v_k,k\ge 1$$

(33)

The processes involved in Equations (32) and (33) satisfy the following properties, which are immediately derived from the model hypotheses (H1)–(H5):

(P1) 

$\left\{H_k;k\ge 1\right\}$ is a sequence of independent random parameter matrices whose entries have known means and second-order moments.

(P2) 

The noise $\left\{v_k;k\ge 1\right\}$ is a zero-mean sequence with known second-order moments defined by the matrices $R_{k,s}\equiv {\left(R_{k,s}^{\left(ij\right)}\right)}_{i,j=1,\dots ,m}$.

(P3) 

The matrices $\left\{{\Gamma }_k;k\ge 2\right\}$ have known means, ${\overline{\Gamma }}_k\equiv E\left[{\Gamma }_k\right]=Diag\left({\overline{\gamma }}_k^{\left(1\right)},\dots ,{\overline{\gamma }}_k^{\left(m\right)}\right)\otimes I_{n_z},k\ge 2$, and ${\Gamma }_k$ and ${\Gamma }_s$ are independent for $|k-s|\ge 2$.

(P4) 

The processes $\{x_k;k\ge 1\},\{H_k;k\ge 1\},\{v_k;k\ge 1\}$ and $\left\{{\Gamma }_k;k\ge 2\right\}$ are mutually independent.

In view of Equations (32) and (33) and the above properties, the study of the LS linear filtering problem based on the stacked observations, $\{y_k;k\ge 1\}$, is completely similar to that of the local filtering problem carried out in Section 3. Therefore, the centralized filtering algorithm described in the following theorem is derived by an analogous reasoning to that used in Theorem 1 and, hence, its proof is omitted.

Theorem 3. 

The centralized LS linear filter, ${\widehat{x}}_{k/k}^{\left(C\right)},$ and the corresponding error covariance matrix, $P_{k/k}^{\left(C\right)}$, are given by

$$\begin{array}{c}{\widehat{x}}_{k/k}^{\left(C\right)}=A_k{O}_k,k\ge 1\hfill \end{array}$$

and

$$P_{k/k}^{\left(C\right)}=A_k{\left(B_k-A_k{r}_k\right)}^T,k\ge 1$$

where the vectors $O_k$ and the matrices $r_k=E\left[O_k{O}_k^T\right]$ are recursively obtained from

$$O_k=O_{k-1}+J_k{\Pi }_k^{-1}{\mu }_k,k\ge 1;O_0=0$$

$$r_k=r_{k-1}+J_k{\Pi }_k^{-1}{J}_k^T,k\ge 1;r_0=0$$

The matrices $J_k=E\left[O_k{\mu }_k^T\right]$ satisfy

$${\displaystyle J_k={\overline{\mathcal{H}}}_{B_k}^T-r_{k-1}{\overline{\mathcal{H}}}_{A_k}^T-\sum _{h=1}^{(k-1)\wedge 2}{J}_{k-h}{\Pi }_{k-h}^{-1}{\mathcal{W}}_{k,k-h}^T,k\ge 2;J_1={\overline{\mathcal{H}}}_{B_1}^T}$$

The innovations, ${\mu }_k$, and their covariance matrices, ${\Pi }_k$, are given by

$${\displaystyle {\mu }_k=y_k-{\overline{\mathcal{H}}}_{A_k}{O}_{k-1}-\sum _{h=1}^{(k-1)\wedge 2}{\mathcal{W}}_{k,k-h}{\Pi }_{k-h}^{-1}{\mu }_{k-h},k\ge 2;{\mu }_1=y_1}$$

and

$$\begin{array}{c}{\displaystyle {\Pi }_k={\Sigma }_k^y-{\overline{\mathcal{H}}}_{A_k}\left({\overline{\mathcal{H}}}_{B_k}^T-J_k\right)-\sum _{h=1}^{(k-1)\wedge 2}{\mathcal{W}}_{k,k-h}{\Pi }_{k-h}^{-1}{\left({\overline{\mathcal{H}}}_{A_k}{J}_{k-h}+{\mathcal{W}}_{k,k-h}\right)}^T,k\ge 2;{\Pi }_1={\Sigma }_1^y}\hfill \end{array}$$

and the coefficients ${\mathcal{W}}_{k,k-h}=E\left[w_k{\mu }_{k-h}^T\right],$ $h=1,2$, verify

$$\begin{array}{c}{\mathcal{W}}_{k,k-1}={\Sigma }_{k,k-1}^y-{\overline{\mathcal{H}}}_{A_k}{\overline{\mathcal{H}}}_{B_{k-1}}^T-{\mathcal{W}}_{k,k-2}{\Pi }_{k-2}^{-1}{\left({\overline{\mathcal{H}}}_{A_{k-1}}{J}_{k-2}+{\mathcal{W}}_{k-1,k-2}\right)}^T,k\ge 3\hfill \\ {\mathcal{W}}_{2,1}={\Sigma }_{2,1}^y-{\overline{\mathcal{H}}}_{A_2}{\overline{\mathcal{H}}}_{B_1}^T\hfill \end{array}$$

$${\mathcal{W}}_{k,k-2}={\overline{\Gamma }}_k{R}_{k-1,k-2}(I-{\overline{\Gamma }}_{k-2}),k\ge 4;{\mathcal{W}}_{3,1}={\overline{\Gamma }}_3{R}_{2,1}$$

In the above formulas, the matrices ${\Sigma }_k^y$ and ${\Sigma }_{k,k-1}^y$ are computed by ${\Sigma }_{k,s}^y={\left({\Sigma }_{k,s}^{y^{\left(ij\right)}}\right)}_{i,j=1,\dots ,m},s=k,k-1$, with ${\Sigma }_{k,s}^{y^{\left(ij\right)}}$ given in Equation (3), and ${\overline{\mathcal{H}}}_{C_k}={\left({\overline{\mathcal{H}}}_{C_k}^{\left(1\right)T},\dots ,{\overline{\mathcal{H}}}_{C_k}^{\left(m\right)T}\right)}^T,C=A,B$, with ${\overline{\mathcal{H}}}_{C_k}^{\left(i\right)}$ defined in Equation (7).

5. Numerical Simulation Example

This section is devoted to analyze the effectiveness of the proposed distributed and centralized filtering algorithms by a simulation example. Let us consider a zero-mean scalar signal process, $\{x_k;k\ge 1\}$, with autocovariance function $E\left[x_k{x}_s\right]=1.025641\times 0.{95}^{k-s},s\le k,$ which is factorizable according to (H1) just taking, for example, $A_k=1.025641\times 0.{95}^k$ and $B_k=0.{95}^{-k}.$

The measured outputs of this signal, which are provided by four different sensors, are described by Equation (1):

$$z_k^{\left(i\right)}=H_k^{\left(i\right)}{x}_k+v_k^{\left(i\right)},k\ge 1,i=1,2,3,4$$

where the processes $\{H_k^{\left(i\right)};k\ge 1\}$ and $\{v_k^{\left(i\right)};k\ge 1\}$, $i=1,2,3,4,$ are defined as follows:

• $H_k^{\left(1\right)}=0.8{\lambda }_k^{\left(1\right)}$, $H_k^{\left(2\right)}={\lambda }_k^{\left(2\right)}\left(0.75+0.95{\epsilon }_k\right)$, $H_k^{\left(3\right)}=0.8{\lambda }_k^{\left(3\right)}$ and $H_k^{\left(4\right)}=0.75{\lambda }_k^{\left(4\right)}$, where $\{{\epsilon }_k;k\ge 1\}$ is a zero-mean Gaussian white process with unit variance, and $\{{\lambda }_k^{\left(i\right)};k\ge 1\}$, $i=1,2,3,4$, are white processes with the following time-invariant probability distributions:

  –

  For $i=1,2$, ${\lambda }_k^{\left(i\right)}$ are Bernoulli random variables with $P[{\lambda }_k^{\left(i\right)}=1]=0.6$.

  –

  ${\lambda }_k^{\left(3\right)}$ is uniformly distributed over $[0.1,0.9]$.

  –

  $P[{\lambda }_k^{\left(4\right)}=0]=0.3,P[{\lambda }_k^{\left(4\right)}=0.5]=0.3,P[{\lambda }_k^{\left(4\right)}=1]=0.4.$

  It is also assumed that the sequences $\{{\epsilon }_k;k\ge 1\}$ and $\{{\lambda }_k^{\left(i\right)};k\ge 1\},i=1,2,3,4,$ are mutually independent.
• The additive noises are defined as $v_k^{\left(i\right)}=c_i({\eta }_k+{\eta }_{k+1}),i=1,2,3,4$, where $c_1=c_4=0.75$, $c_2=1$, $c_3=0.5$, and $\{{\eta }_k;k\ge 1\}$ is a zero-mean Gaussian white process with unit variance.

Note that the sequences of random variables $\{H_k^{\left(i\right)};k\ge 1\}$, $i=1,2,3,4,$ model different types of uncertainty in the measured outputs: missing measurements in sensor 1; both missing measurements and multiplicative noise in sensor 2; and continuous and discrete gain degradation in sensors 3 and 4, respectively. Moreover, it is clear that the additive noises $\{v_k^{\left(i\right)};k\ge 1\}$, $i=1,2,3,4,$ are only correlated at the same and consecutive time instants, with $R_k^{\left(ij\right)}=2c_i{c}_j,R_{k,k-1}^{\left(ij\right)}=c_i{c}_j,i,j=1,2,3,4.$

Next, according to our theoretical observation model, it is supposed that, at any sampling time $k\ge 2$, the data transmissions are subject to random one-step delays with different rates and such delays are correlated at consecutive sampling times. More precisely, let us assume that the available measurements $y_k^{\left(i\right)}$ are given by Equation (2):

$$y_k^{\left(i\right)}=(1-{\gamma }_k^{\left(i\right)})z_k^{\left(i\right)}+{\gamma }_k^{\left(i\right)}{z}_{k-1}^{\left(i\right)},k\ge 2,i=1,2,3,4$$

where the variables ${\gamma }_k^{\left(i\right)}$ modeling this type of correlated random delays are defined using three independent sequences of independent Bernoulli random variables, $\{{\theta }_k^{\left(i\right)};k\ge 1\}$, $i=1,2,3$, with constant probabilities, $P[{\theta }_k^{\left(i\right)}=1]={\overline{\theta }}^{\left(i\right)}$, for all $k\ge 1$; specifically, for $i=1,2,3,$ ${\gamma }_k^{\left(i\right)}={\theta }_{k+1}^{\left(i\right)}(1-{\theta }_k^{\left(i\right)}),$ and ${\gamma }_k^{\left(4\right)}={\theta }_k^{\left(1\right)}(1-{\theta }_{k+1}^{\left(1\right)}).$

It is clear that the sensor delay probabilities are time-invariant: ${\overline{\gamma }}^{\left(i\right)}={\overline{\theta }}^{\left(i\right)}(1-{\overline{\theta }}^{\left(i\right)})$, for $i=1,2,3$, and ${\overline{\gamma }}^{\left(4\right)}={\overline{\gamma }}^{\left(1\right)}$. Moreover, the independence of the sequences $\{{\theta }_k^{\left(i\right)};k\ge 1\}$, $i=1,2,3$, together with the independence of the variables in each sequence, guarantee that the random variables ${\gamma }_k^{\left(i\right)}$ and ${\gamma }_s^{\left(j\right)}$ are independent if $|k-s|\ge 2$, for any $i,j=1,2,3,4$. Also, it is clear that, at each sensor, the variables $\{{\gamma }_k^{\left(i\right)};k\ge 2\}$ are correlated at consecutive sampling times and ${\overline{\gamma }}_{k,s}^{\left(ii\right)}=0$, for $i=1,2,3,4$ and $|k-s|=1$. Finally, we have that $\{{\gamma }_k^{\left(4\right)};k\ge 2\}$ is independent of $\{{\gamma }_k^{\left(i\right)};k\ge 2\}$, $i=2,3$, but correlated with $\{{\gamma }_k^{\left(1\right)};k\ge 2\}$ at consecutive sampling times, with ${\overline{\gamma }}_{k,k-1}^{\left(14\right)}={\overline{\gamma }}^{\left(1\right)}{\overline{\theta }}^{\left(1\right)}$ and ${\overline{\gamma }}_{k,k-1}^{\left(41\right)}={\overline{\gamma }}^{\left(1\right)}(1-{\overline{\theta }}^{\left(1\right)})$.

Let us observe that, for each sensor $i=1,2,3,4$, if ${\gamma }_k^{\left(i\right)}=1$, then ${\gamma }_{k+1}^{\left(i\right)}=0$; this fact guarantees that, when the measurement at time k is delayed, the available measurement at time $k+1$ is well-timed. Therefore, this correlation model avoids the possibility of two consecutive delayed observations at the same sensor.

Table 1. Sensor 1 data transmission.

Time k	1	2	3	4	5	6	7	8	9	10	11	12	13	14	15
${\theta }_k^{\left(1\right)}$		1	1	1	0	0	1	0	1	1	1	0	0	1	1
${\gamma }_k^{\left(1\right)}$		0	0	1	0	0	1	0	0	0	1	0	0	0
$y_k^{\left(1\right)}$	$z_1^{\left(1\right)}$	$z_2^{\left(1\right)}$	$z_3^{\left(1\right)}$	$z_3^{\left(1\right)}$	$z_5^{\left(1\right)}$	$z_6^{\left(1\right)}$	$z_6^{\left(1\right)}$	$z_8^{\left(1\right)}$	$z_9^{\left(1\right)}$	$z_{10}^{\left(1\right)}$	$z_{10}^{\left(1\right)}$	$z_{12}^{\left(1\right)}$	$z_{13}^{\left(1\right)}$	$z_{14}^{\left(1\right)}$

shows an example of data transmission in sensor 1 when ${\overline{\theta }}^{\left(1\right)}=0.5$.

Note that if ${\gamma }_k^{\left(1\right)}=0$, there is no delay at time k; i.e., the output $z_k^{\left(1\right)}$ is received on time by the fusion center and $y_k^{\left(1\right)}=z_k^{\left(1\right)}$. If ${\gamma }_k^{\left(1\right)}=1$, the packet received at time k is the output at $k-1$; i.e., there is one-step delay and the processed observation is $y_k^{\left(1\right)}=z_{k-1}^{\left(1\right)}$. From Table 1, we see that $z_4^{\left(1\right)},z_7^{\left(1\right)}$ and $z_{11}^{\left(1\right)}$ are are lost, and $z_3^{\left(1\right)},z_6^{\left(1\right)}$ and $z_{10}^{\left(1\right)}$ are re-received.

To illustrate the feasibility and analyze the effectiveness of the proposed estimators, the algorithms were implemented in MATLAB, and a hundred iterations were run. In order to measure the estimation accuracy, the error variances of both distributed and centralized fusion estimators were calculated for several values of the delay probabilities at the different sensors, obtained from several values of ${\overline{\theta }}^{\left(i\right)}$. Let us observe that the delay probabilities, ${\overline{\gamma }}^{\left(i\right)}={\overline{\theta }}^{\left(i\right)}(1-{\overline{\theta }}^{\left(i\right)})$, for $i=1,2,3$, are the same if $1-{\overline{\theta }}^{\left(i\right)}$ is used instead of ${\overline{\theta }}^{\left(i\right)}$; for this reason, only the case ${\overline{\theta }}^{\left(i\right)}\le 0.5$ will be considered here.

First, the error variances of the local, distributed and centralized filters will be compared considering the same delay probabilities for the four sensors. Figure 1 displays these error variances when ${\overline{\theta }}^{\left(i\right)}=0.3$, $i=1,2,3$, which means that the delay probability at every sensor is ${\overline{\gamma }}^{\left(i\right)}=0.21$. This figure shows that the error variances of the distributed fusion filtering estimator are lower than those of every local estimators, but slightly greater than those of the centralized one. However, this slight difference is compensated by the fact that the distributed fusion structure reduces the computational cost and has better robustness and fault tolerance. Analogous results are obtained for other values of ${\overline{\theta }}^{\left(i\right)}$. Actually, Figure 2 displays the distributed and centralized filtering error variances for ${\overline{\theta }}^{\left(i\right)}=0.1,0.2,0.3,0.4,0.5$, which lead to the delay probabilities ${\overline{\gamma }}^{\left(i\right)}=0.09,0.16,0.21,0.24,0.25$, respectively. In this figure, both graphs (corresponding to the distributed and centralized fusion filters, respectively) show that the performance of the filters is poorer as ${\overline{\theta }}^{\left(i\right)}$ increases. This fact was expected as the increase of ${\overline{\theta }}^{\left(i\right)}$ yields a rise in the delay probabilities. This figure also confirms that both methods, distributed and centralized, have approximately the same accuracy, thus corroborating the previous results.

In order to carry out a further discussion on the effects of the sensor random delays, Figure 3 shows a comparison of the filtering error variances in the following cases:

• Case I: error variances versus ${\overline{\theta }}^{\left(1\right)}$, when ${\overline{\theta }}^{\left(2\right)}={\overline{\theta }}^{\left(3\right)}=0.5$. In this case, as mentioned above, the values ${\overline{\theta }}^{\left(1\right)}=0.1,0.2,0.3,0.4,0.5$, lead to the values ${\overline{\gamma }}^{\left(1\right)}={\overline{\gamma }}^{\left(4\right)}=0.09,0.16,0.21,0.24,0.25$, respectively, for the delay probabilities of sensors 1 and 4, whereas the delay probabilities of sensors 2 and 3 are constant and equal to 0.25.
• Case II: error variances versus ${\overline{\theta }}^{\left(1\right)}$, when ${\overline{\theta }}^{\left(2\right)}={\overline{\theta }}^{\left(1\right)}$ and ${\overline{\theta }}^{\left(3\right)}=0.5$. Varying ${\overline{\theta }}^{\left(1\right)}$ as in Case I, the delay probabilities of sensors 1, 2 and 4 are equal and take the aforementioned values, whereas the delay probability of sensor 3 is constant and equal to 0.25.
• Case III: error variances versus ${\overline{\theta }}^{\left(1\right)}$, when ${\overline{\theta }}^{\left(2\right)}={\overline{\theta }}^{\left(3\right)}={\overline{\theta }}^{\left(1\right)}$. Now, as in Figure 2, the delay probabilities of the four sensors are equal, and they all take the aforementioned values.

Since the behavior of the error variances is analogous in all the iterations, only the results of a specific iteration ($k=100$) are displayed in Figure 3, which shows that the performance of the distributed and centralized estimators is indeed influenced by the probability ${\overline{\theta }}^{\left(i\right)}$ and, as expected, better estimations are obtained as ${\overline{\theta }}^{\left(i\right)}$ becomes smaller, due to the fact that the delay probabilities, ${\overline{\gamma }}^{\left(i\right)}$, decrease with ${\overline{\theta }}^{\left(i\right)}$. Moreover, this figure shows that the error variances in Case III are less than those of Case II which, in turn, are lower than those of Case I. This is due to the fact that, while the delay probabilities of the four sensors are varied in Case III, only two and three sensors vary their delay probabilities in Cases I and II, respectively. Since the constant delay probabilities of the other sensors are assumed to take their greatest possible value, this figure confirms that the estimation accuracy improves as the delay probabilities decrease.

6. Conclusions

In this paper, distributed and centralized fusion filtering algorithms have been designed in multi-sensor systems from measured outputs with random parameter matrices and correlated noises, assuming correlated random delays in transmissions. The main outcomes and results can be summarized as follows:

• Information on the signal process: our approach, based on covariance information, does not require the evolution model generating the signal process to design the proposed distributed and centralized filtering algorithms; nonetheless, they are also applicable to the conventional formulation using the state-space model.
• Signal uncertain measured outputs: random measurement matrices and cross-correlation between the different sensor noises are considered in the measured outputs, thus providing a unified framework to address different network-induced phenomena, such as missing measurements or sensor gain degradation, along with correlated measurement noises.
• Random one-step transmission delays: the fusion estimation problems are addressed assuming random one-step delays in the outputs transmission to the fusion center through the network communication channels; the delays have different characteristics at each sensor and they are assumed to be correlated and cross-correlated at consecutive sampling times. This correlation assumption covers many situations where the common assumption of independent delays is not realistic; for example, networked systems with stand-by sensors for the immediate replacement of a failed unit, thus avoiding the possibility of two successive delayed observations.
• Fusion filtering algorithms: firstly, recursive algorithms for the local LS linear signal filters based on the measured output data coming from each sensor have been designed by an innovation approach; the computational procedure of the local algorithms is very simple and suitable for online applications. After that, the matrix-weighted sum that minimizes the mean-squared estimation error is proposed as distributed fusion estimator. Also, using covariance information, a recursive centralized LS linear filtering algorithm, with analogous structure to that of the local algorithms, is proposed. The accuracy of the proposed fusion estimators, obtained under the LS optimality criterion, is measured by the error covariance matrices, which can be calculated offline as they do not depend on the current observed data set.
• Simulations: a numerical simulation example has illustrated the usefulness of the proposed algorithms for the estimation of a scalar signal. Error variance comparisons have shown that both distributed and centralized fusion filters outperform the local ones, as well as a slight superiority of the centralized fusion estimators over the distributed ones. The effects of the delays on the estimators performance have been also analyzed by the error variances. This example has also highlighted the applicability of the proposed algorithms to different multi-sensor systems with stochastic uncertainties, which can be dealt with using the observation model with random measurement matrices considered in this paper.