Abstract
In this paper, the fractal properties of stochastic processes and objects in different areas were specified and investigated. These included: measuring systems and sensors, navigation and motion controls, telecommunication systems and networks, and flaw detection technologies. Additional options that occur through the use of fractality were also indicated and exemplified for each application. Regarding the problems associated with navigation information processing, the following fractal nature processes were identified: errors of inertial sensors based on the microelectromechanical systems called MEMS, in particular gyroscopic drift and accelerometer bias, and; the trajectory movement of mobile objects. With regard to navigation problems specifically, the estimation problem statement and its solution are given by way of the Bayesian approach for processing fractal processes. The modified index of self-similarity for telecommunication series was proposed, and the self-similarity of network traffic based on the R/S method and wavelet analysis was identified. In failure detection, fractality manifested as porosity, wrinkles, surface fractures, and ultrasonic echo signals measured using non-destructive sensors used for rivet compound testing.
1. Introduction
Many processes in natural and artificial systems are known to have fractal structures [1,2]. Currently, the fractal properties of objects and processes continue to be studied in many areas [3]. With the development of higher-precision sensors and improved measuring and diagnostic systems, a need to improve our understanding of fractal structures and system errors has arisen. One goal of contemporary research in this area is to improve the cybersecurity of modern systems. The use of fractality allows mathematical models of processes and objects to be refined, thereby helping to overcome problems of analysis and synthesis to achieve greater competence.
This article examines the features of stochastic process models with fractal properties and their applications in some important areas. These areas include: sensors and measuring systems [4,5], navigation and motion controls [6,7], telecommunication systems [3,8,9], and flaw detection technologies [10,11].
The structure of the paper is as follows: processes and objects of a fractal nature in key areas. The possibility of using fractal properties to improve the quality of problem solving is then by evaluated. Following this, the positive effects of fractality in these contexts is considered.
2. Fractal Process Model
First-order Markov processes have been widely used in practice. However, there are others random processes with short- and long-term memory.
One possible model by which to understand the higher-order Markov process as it applies to memory, is a model of fractional Brownian motion [12,13] (fractional Wiener process—FWP) containing the Hurst parameter.
To identify the features of the fractional structure of the process, fractality indicators such as the Hurst parameter are used. Several methods are used to estimate the Hurst parameter, including: rescaled range analysis (the R/S method), variance change graph analysis, and wavelet analysis [13,14]. According to the R/S method, the Hurst parameter of a time series is calculated by the following formula:
where R is the range of the first n cumulative deviations from the mean, S is the standard deviation of observations, and n is the number of observations.
The FWP is called a random process with Hurst parameter H () if has a Gaussian distribution with zero mathematical expectation and variance , where σ is a positive constant, namely its probability measure [1].
at H = 0.5, the FWP is consistent with classical Brownian movement (the classical Wiener process—CWP). The increments of fractional Brownian motion are called fractional Gaussian noise, with variance obeying the ratio .
At Hurst parameter H: (1) if , then the process has anti-persistent properties, when an upward trend is replaced by a downward trend or vice versa; (2) if , then the process is consistent with the classical Brownian movement; (3) if , then the process has persistent (i.e., trend-resistant) properties.
5. Fractal Process Filtering
To clearly identify the features of filtration in the fractal process, we intentionally choose the simplest model to express the FWP. It is necessary to evaluate the coordinate of a fractal Wiener process
using linear measures of type , where are the moments of time and are the zero-mean Gaussian white noises independent of each other and of , with variances and , respectively. Here, the values of the process at the initial represent the random zero-mean Gaussian variable with covariance at the .
Modeling parameters: initial state , ; , discretization period . The FWP (11) was modeled using the wfbm function in the MatLab mathematical package, which is based on wavelet decomposition and simulates a fractal Wiener sequence with a given Hurst parameter.
Kalman filtering and a non-recurrent Bayesian algorithm (BA) of optimal linear filtering were used to obtain the required estimate [28].
It is essential that if, for the classical Wiener process, increments Wi are independent, then the FWP does not have this property and is not a Markov process, except in cases where H = 0.5 when the FWP is consistent with the CWP. In such cases, KF only gives the optimal solution for this value of H parameter and is not optimal with other H parameter values.
In general, when , optimal estimations of non-recurrent BA and expected (analysis) covariance matrices for estimation error , are determined by means of the following expressions [28,29]:
where are covariance matrices.
The selective (valid) r.m.s. of the estimation errors are presented, calculated as
Modeling and estimation of the FWP process was carried out with different Hurst parameters: H: 0.1; 0.5; 0.9 (Figure 4). The number of measurements can be expressed as .
Figure 4.
R.m.s. of estimation errors with different Hurst parameters (H.). (a) H = 0.1, (b) H = 0.5, (c) H = 0.9.
As Figure 4a–c show is the expected r.m.s of estimation errors corresponding to the error variance of optimal estimation, which is the only element of the analysis matrix of KF covariance errors. is the selective r.m.s of filtering errors when using KF; is the expected r.m.s. of filtering errors when using non-recurrent BA; is the selective r.m.s. of filtering errors for BA, and is the selective r.m.s. of measurement errors.
The results show the coincidence of the expected (12) and the valid (13) accuracy characteristics of the presented optimal linear algorithm for non-recurrent estimation. When parameter H = 0.1, higher estimation accuracy can be achieved with the help of the optimal linear algorithm than with KF. When the parameter H = 0.5, both KF and the linear optimal algorithm estimate the random process with equal accuracy. When parameter H = 0.9, for KF, estimation error is increased in comparison to the optimal linear algorithm. A mismatch between the results of analysis and the actual (selective) characteristic for KF is observed at H = 0.1 and H = 0.9, respectively.
The study shows that a higher estimation accuracy can be achieved using non-recurrent algorithms, unlike KF.
In navigation and motion control, the values of the Hurst parameter for object motion models may change due to changes in the state of the environment (e.g., turbulence, weather conditions, natural phenomena, etc.).
For Kalman-type algorithms to be efficient, it is necessary to solve the adaptive problem of estimation by introducing and evaluating an unknown parameter—the fractal parameter H.
6. Information and Telecommunication System
The development and research of mathematical models of network telecommunication traffic allow us to define the boundaries of network performance and optimize the network structure of the system to minimize queueing delays. Traditional network traffic models show pulsations on short time scales but very smooth traffic at larger scales. Regardless, traffic shows variability over a wide range of time scales. When studying network telecommunication traffic, one of the important tasks is to identify anomalies and respond to them early.
Analyses of network telecommunication traffic result in time series (TS) analyses most widely used in traditional methods of statistically analyzing random variable functions. Alongside with traditional methods the signal processing methods based on fractal and wavelet-transformations [5,7,9,10,14,18,19], have seen more widespread use in recent years. The first of these analyses is specifically concerned with the identification of fractal properties that allow time series’ to be attributed to predetermined models. One distinct benefit of these analyses is their ability to reveal features of local structures and the different properties of complex signals that would otherwise be invisible using standard, real-time representations.
Telecommunication network traffic exhibits self-similar properties over a wide range of time scales that are very different to the properties of traditional models. Self-similar models are appropriate for telecommunication network traffic, as they have the capacity to estimate network performance/quality, allocate resources, and ensure quality of service [9].
Therefore, there is a need to develop new algorithms and modify those that exist for the purpose of analyzing the information systems (IS) of telecommunication series.
In order to analyze the telecommunication system, the use of an algorithm consisting of the following steps was proposed:
- (1)
- Pre-processing of the traffic time series consisting of statistical data sampling with the purpose of generating the TS we are interested in;
- (2)
- Estimation of fractality indicators using different methods such as R/S methods and wavelet analyses;
- (3)
- Identification of the mathematical models of TS by approximation to known models, or through synthesizing the structures and parameters of mathematical TS models.
To reduce the possibility of misinterpreting results of the parameter H evaluation, we propose to analyze not only the entire sample, but also the individual blocks of the sample. In this context, we propose to consider the blocks separately with a window offset and/or in a progressive way. Depending on the parameter H estimation method, we will make further calculations for each concerned block(s) separately to determine the expected value of the results found. This modified Hurst parameter, in the author’s opinion, will more adequately reflect the real environmental issues associated with identifying the fractal properties of telecommunication time series.
The result of the analyses proposed here will provide full objective information about the telecommunication time series of IS, with the determined characteristics allowing for the identification of a mathematical TS model. To solve some practical problems, for example, the identification of anomalies in the network traffic that may impact IS data integrity, it is necessary to compare the TS with an identified model and compare the results.
In order to analyze telecommunication traffic, we will consider the time series of an organization’s incoming and outgoing internet traffic (Figure 5). The organization selected will have an average traffic volume of more than 160 Gbytes per day.
Figure 5.
Scheme of the organization’s telecommunication system with incoming and outgoing Internet traffic.
Let us consider two time series of incoming and outgoing internet traffic for an organization with an average volume of more than 160 Gbyte a day. Let the first TS be collected over a sampling period of 60 days with sample spacing equal to 1 h, and let the second TS be sampled over 7 days, with sample spacing equal to 1 min. The parameter H can be obtained by charting the dependence of on and then using the obtained points to match a straight line with a slope of parameter H by the least squares method. Here, we will henceforth consider E the symbol of the expected value.
Figure 6 shows the dependence of the standardized range logarithms on the logarithms of range lengths, and the linear regression with a slope of parameter H according to the R/S-method.
Figure 6.
Characteristics of information and telecommunication systems: (a,c) show the analysis of 2-month, and weekly, series of intensity, respectively, in bytes; (b,d)—in packages.
The time series were divided into blocks in a progressive way, with spacing of 100 discrete points, i.e., the first block included 100 values, the second included 200, the third included 300, etc. Each block, in turn, was divided into intervals ranging in size from 10 discrete points to a 20% block length increase in size between adjacent intervals. For each interval, the R/S ratio and the R/S mathematical expectation of the given block were calculated.
While investigating the information and telecommunication systems, the parameter H ≥ 0.8. Therefore, this process has persistent properties. Because of this, we propose to use fractality indicators for the time series model description, along with various traffic indicators (byte intensity per time unit, batches intensity per time unit, average batch size, throughput, loss rate, channel delay, loading, etc.).
In addition to the network traffic model, the fractality indicators can also be used to determine threats to information resources by solving a network classification problem [19]. Thus, the paper [19] proposes the modeling and implementation of a threat protection system with an attack forecast model mode of adaptation and parameter setting based on intelligent technologies in addition to fractal and wavelet analyses.
Thus, in telecommunication systems, the Hurst parameter can serve as an indicator when abnormal influences occur in the system (unauthorized access, computer attacks, etc.).
7. Defect Detection
Today, developments relating to the transition to advanced digital intelligent manufacturing technologies, robotic systems, big data processing systems using artificial intelligence, and machine learning continue to actively develop. In every industry, the use of non-destructive testing methods is able to investigate components’ properties on site or in the field. Non-destructive testing methods appeal because they are much cheaper and faster than traditional, destructive, tests and do not cause any damage to the constructions’ components.
Methods of image recognition using photo- and camcorder-sourced images are used to detect defects [30,31]. Another effective approach is an ultrasonic method of non-destructive testing [32,33], which can be operated using flaw detectors.
Fractality manifests as porosity, wrinkles, and surface fractures, all of which can be detected during organoleptic testing and by ultrasonic echo signals by non-destructive control of rivet joints.
The analysis of non-destructive testing signals was carried out to identify their fractal properties.
Figure 7 represents the observed echo signals during non-destructive testing using an ultrasonic flaw detector (Olympus EPOCH LTC) with an accuracy of measuring rivet length up to 0.01 mm. The accuracy of measuring the echo signal amplitude is up to 0.25%.
Figure 7.
Echo signals of ultrasonic flaw detector during non-destructive testing of rivet joints: (a) is a normal rivet; (b) defect in the middle of the rivet at the 80% undercut; (c) defect in the middle of the rivet at the 50% undercut; (d) defect at the rivet cap base at the 50% undercut.
The red line is a strobe for detecting defects. Rivet defects differ in the type of echo signal in relation to this strobe.
The Hurst parameter was calculated for 28 implementations of echo signals of an ultrasonic flaw detector for each of the normal groups, and for three groups with defective rivet types. For normal rivet joints, the parameter H was approximately 0.2, whereas for all the defective rivets it was about 0.35. This can serve as a reliable indicator of the presence or absence of a defect in binary classification. As we have shown in [34] in the case of binary classification, 100% accuracy can be achieved using both deep neural networks with an LSTM layer, and by estimating the Hurst parameter H for the same source data.
8. Conclusions
Following the specification and investigation of the fractal properties of processes and objects in different areas, the present study showed that when constructing models of processes and objects in various domains, proper allowances must be made for fractality.
A stochastic modeling process based on the fractal Wiener process was proposed, with provision for the Hurst parameter.
Relevant to the problems of navigation information processing, the following fractal nature processes were identified: errors of inertial sensors based on the microelectromechanical systems called MEMS, in particular the gyroscopic drift and accelerometer biases, and the trajectory movement of mobile objects.
New mathematical models of inertial sensor errors based on the fractal Wiener process were presented.
New models of object motion based on the use of the fractional Wiener process were also proposed. The specific nature of estimating fractal process parameters using Kalman-type and non-recurrent Bayesian algorithms were investigated. Our illustrative examples show that, when estimating the state of the studied processes, fractality must be accounted for.
In addition, we revealed that the traffic in information systems has a fractal nature. A modified index of self-similarity for telecommunication series was proposed, and we identified network traffic self-similarity based on the R/S method and wavelet analysis. At the same time, we proposed to use the fractality indicator when identifying threats to information resource protection systems.
In failure detection, fractality is manifested as porosity, wrinkles, surface fractures, and ultrasonic echo signals through the non-destructive testing of rivet compounds. We recommend using the Hurst parameter when seeking the reliable binary classification of defects in rivet joints.
Author Contributions
Conceptualization, O.S.A. and S.G.A.; methodology, O.S.A.; software, S.G.A.; validation, O.S.A. amd S.G.A.; formal analysis, O.S.A. and S.G.A.; investigation, O.S.A.; resources, S.G.A.; data curation, O.S.A.; writing—original draft preparation, O.S.A. and S.G.A.; visualization, S.G.A.; supervision, O.S.A. and S.G.A.; project administration, O.S.A.; funding acquisition, O.S.A. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
A study involving humans or animals is absent.
Informed Consent Statement
A study involving humans is absent.
Data Availability Statement
https://www.scopus.com/authid/detail.uri?authorId=6505799329 (accessed on 2 September 2021).
Conflicts of Interest
The authors declare no conflict of interest.
References
- Crownover, R.M. Introduction to Fractals and Chaos; Jones and Bartlett Publishers, Inc.: Boston, MA, USA; London, UK, 1995. [Google Scholar]
- Aguirre, J.; Viana, R.L.; Sanjuan, M.A.F. Fractal structures in nonlinear dynamics. Rev. Mod. Phys. 2009, 81, 333–386. [Google Scholar] [CrossRef]
- Nualart, D. Fractional Brownian motion: Stochastic calculus and applications. In Proceedings of the International Congress of Mathematicians, Madrid, Spain, 22–30 August 2006; pp. 1541–1562. [Google Scholar]
- Stepanov, O.A.; Motorin, A.V. Performance Criteria for the Identification of Inertial Sensor Error Models. Sensors 2019, 19, 1997. [Google Scholar] [CrossRef] [Green Version]
- Yang, X.B.; Jin, X.Q.; Du, Z.M.; Zhu, Y.H. A novel model-based fault detection method for temperature sensor using fractal correlation dimension. Build. Environ. 2011, 46, 970–979. [Google Scholar] [CrossRef]
- Yang, L.; Sun, Z.L.; Xu, C.; Chai, X.D. The Application of Software Reliability Based on Fractal Theory in Integrated Navigation System. In Proceedings of the 2013 International Forum on Special Equipments and Engineering Mechanics, Nanjing, China, 27–28 July 2016; pp. 118–122. [Google Scholar]
- Han, T.; Yang, Y.X.; Huang, G.W. Vertical scaling optimization algorithm for a fractal interpolation model of time offsets prediction in navigation systems. Appl. Math. Model. 2021, 90, 862–874. [Google Scholar] [CrossRef]
- Liu, J. Fractal Network Traffic Analysis with Applications. Ph.D. Thesis, Georgia Institute of Technology, Atlanta, GA, USA, 2006; 115p. [Google Scholar]
- Radev, D.; Lokshina, I.; Radeva, S. Modeling and Simulation of Self-Similar Traffic for Wireless IP Networks. In Proceedings of the 2009 Wireless Telecommunications Symposium, Prague, Czech Republic, 22–24 April 2009. [Google Scholar] [CrossRef]
- Xianglin, Z.; Jin, S.J. A Fractal-Based Flaw Feature Extraction Method for Ultrasonic Phased Array Nondestructive Testing. In Proceedings of the International Conference on Mechatronics and Automation, Changchun, China, 9–12 August 2009. [Google Scholar] [CrossRef]
- Jovančević, I.; Pham, H.H.; Orteu, J.J.; Gilblas, R.; Harvent, J.; Maurice, X.; Brèthes, L. 3D Point Cloud Analysis for Detection and Characterization of Defects on Airplane Exterior Surface. J. Nondestruct. Eval. 2017, 36, 1–17. [Google Scholar] [CrossRef] [Green Version]
- Kolmogorov, A.N. Wienersche Spiralen und Einige Interessante Kurven im Hilbertschen Raum. C.R. (Doklady) Acad. URSS (N.S.) 1940, 26, 115–118. [Google Scholar]
- Benoit, B.M.; Van Ness, J.W. Fractional Brownian Motions, Fractional Noises and Applications. SIAM Rev. 1968, 10, 422–437. [Google Scholar]
- Amosov, O.S.; Amosova, S.G.; Muller, N.V. Identification of potential risks to system security using wavelet analysis, the time-and-frequency distribution indicator of the time series and the correlation analysis of wavelet-spectra. In Proceedings of the 2018 International Multi-Conference on Industrial Engineering and Modern Technologies (FarEastCon), Vladivostok, Russia, 3–4 October 2018. [Google Scholar]
- Stepanov, O.A.; Motorin, A.V. Comparison of methods for identifying sensor error models based on Allan variations and nonlinear filtering algorithms. In Proceedings of the XXI St. Petersburg International Conference on Integrated Navigation Systems, St. Petersburg, Russia, 2–7 October 2018; pp. 98–103. [Google Scholar]
- Bar-Shalom, Y. Estimation with Applications to Tracking and Navigation; Bar-Shalom, Y., Li, X.-R., Kirubarajan, T., Eds.; John Wiley & Sons: New York, NY, USA, 2001; 558p. [Google Scholar]
- Gosteva, N.D.; Litvinenko, Y.A. Research of a mathematical model of care of a two-stage float gyroscope. In Proceedings of the XV Conference of Young scientists “Navigation and Motion Control”, St. Petersburg, Russia, 2–7 October 2018; pp. 117–125. [Google Scholar]
- Amosov, O.S.; Baena, S.G. Wavelet Based Filtering of Mobile Object Fractional Trajectory Parameters. In Proceedings of the IEEE International Conference on Control and Automation (IEEE ICCA 2017), Ohrid, Macedonia, 3–6 July 2017; pp. 118–123. [Google Scholar]
- Amosov, O.S.; Amosova, S.G.; Magola, D.S. Identification of information recourses threats based on intelligent technologies, fractal and wavelet analysis. In Proceedings of the 2018 IEEE International Conference on Applied System Innovation (ICASI), Chiba, Japan, 13–17 April 2018; pp. 528–531. [Google Scholar]
- Doering, E. NI myRIO Project Essentials Guide; Rose-Hulman Institute of Technology; National Technology and Science Press, 2016; p. 249. Available online: https://download.ni.com/evaluation/academic/myRIO_project_essentials_guide__Feb_09_2016___optimized.pdf (accessed on 2 September 2021).
- MEMS Motion Sensors: Ultra-Stable Three-Axis Digital Output Gyroscope L3G4200D. Available online: https://www.mouser.com/datasheet/2/389/l3g4200d-954834.pdf (accessed on 2 September 2021).
- Abry, P.; Flandrin, P.; Taqqu, M.S.; Veitch, D. Self-similarity and long-range dependence through the wavelet lens. Theory Appl. Long-Range Depend. 2003, 1, 527–556. [Google Scholar]
- Bardet, J.-M.; Lang, G.; Oppenheim, G.; Philippe, A.; Stoev, S.; Taqqu, M.S. Semi-parametric estimation of the long-range dependence parameter: A survey. Theory Appl. Long-Range Depend. 2003, 557, 557–577. [Google Scholar]
- Flandrin, P. Wavelet analysis and synthesis of fractional Brownian motion. IEEE Trans. Inf. Theory 1992, 38, 910–917. [Google Scholar] [CrossRef]
- Digital Accelerometer ADXL345. Available online: https://www.analog.com/media/en/technical-documentation/data-sheets/ADXL345.pdf (accessed on 2 September 2021).
- Kuzmin, S.Z. Digital Radar. Introduction to the Theory; KVITS Publishing House: Kiev, Ukraine, 2000; 428p. [Google Scholar]
- Amosov, O.S. Markov sequence filtering on the basis of bayesian and neural network approaches and fuzzy logic systems in navigation data processing. J. Comput. Syst. Sci. Int. 2004, 43, 551–559. [Google Scholar]
- Amosov, O.S. Peculiarities of stochastic processes with fractal properties and their applications in problems of navigation information processing. In Proceedings of the 25th Saint Petersburg International Conference on Integrated Navigation Systems, ICINS 2018, Saint Petersburg, Russia, 28–30 May 2018; Volume 137790, pp. 1–5. [Google Scholar]
- Stepanov, O.A.; Amosov, O.S. Nonrecurrent Linear Estimation and Neural Networks. IFAC Proc. Vol. 2004, 37, 213–218. [Google Scholar] [CrossRef]
- Lv, X.; Duan, F.; Jiang, J.J.; Fu, X.; Gan, L. Deep Metallic Surface Defect Detection: The New Benchmark and Detection Network. Sensors 2020, 20, 1562. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Chu, H.-H.; Wang, Z.-Y. A vision-based system for post-welding quality measurement and defect detection. Int. J. Adv. Manuf. Technol. 2016, 86, 3007–3014. [Google Scholar] [CrossRef]
- Fan, Y.; Park, U.; Udpa, L.; Ramuhalli, P.; Shih, W.; Stockman, G.C. Automated rivet inspection for aging aircraft with magneto-optic imager. Electromagn. Nondestruct. Eval. (IX) 2005, 25, 185–194. [Google Scholar]
- Lingvall, F.; Stepinski, T. Automatic detecting and classifying defects during eddy current inspection of riveted lap-joints. NDT&E Int. 2000, 33, 47–55. [Google Scholar]
- Amosov, O.S.; Amosova, S.G.; Iochkov, I.O. Defects Detection and Recognition in Aviation Riveted Joints by Using Ultrasonic Echo Signals of Non-Destructive Testing. In Proceedings of the 17th IFAC Symposium on Information Control Problems in Manufacturing, IFAC INCOM 2021, Budapest, Hungary, 7–9 June 2021; pp. 484–489. [Google Scholar]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).