Entropy — Open Access Journal

The Voronoi entropy is a mathematical tool for quantitative characterization of the orderliness of points distributed on a surface. The tool is useful to study various surface self-assembly processes. We provide the historical background, from Kepler and Descartes to our days, and discuss topological properties of the Voronoi tessellation, upon which the entropy concept is based, and its scaling properties, known as the Lewis and Aboav–Weaire laws. The Voronoi entropy has been successfully applied to recently discovered self-assembled structures, such as patterned microporous polymer surfaces obtained by the breath figure method and levitating ordered water microdroplet clusters. Full article

In frequentist inference, minimizing the Hellinger distance between a kernel density estimate and a parametric family produces estimators that are both robust to outliers and statistically efficient when the parametric family contains the data-generating distribution. This paper seeks to extend these results to the use of nonparametric Bayesian density estimators within disparity methods. We propose two estimators: one replaces the kernel density estimator with the expected posterior density using a random histogram prior; the other transforms the posterior over densities into a posterior over parameters through minimizing the Hellinger distance for each density. We show that it is possible to adapt the mathematical machinery of efficient influence functions from semiparametric models to demonstrate that both our estimators are efficient in the sense of achieving the Cramér-Rao lower bound. We further demonstrate a Bernstein-von-Mises result for our second estimator, indicating that its posterior is asymptotically Gaussian. In addition, the robustness properties of classical minimum Hellinger distance estimators continue to hold. Full article

Reservoir computers (RCs) are biology-inspired computational frameworks for signal processing that are typically implemented using recurrent neural networks. Recent work has shown that Boolean networks (BN) can also be used as reservoirs. We analyze the performance of BN RCs, measuring their flexibility and identifying the factors that determine the effective approximation of Boolean functions applied in a sliding-window fashion over a binary signal, both non-recursively and recursively. We train and test BN RCs of different sizes, signal connectivity, and in-degree to approximate three-bit, five-bit, and three-bit recursive binary functions, respectively. We analyze how BN RC parameters and function average sensitivity, which is a measure of function smoothness, affect approximation accuracy as well as the spread of accuracies for a single reservoir. We found that approximation accuracy and reservoir flexibility are highly dependent on RC parameters. Overall, our results indicate that not all reservoirs are equally flexible, and RC instantiation and training can be more efficient if this is taken into account. The optimum range of RC parameters opens up an angle of exploration for understanding how biological systems might be tuned to balance system restraints with processing capacity. Full article

Several optimization models of irreversible reverse cycle machines have been developed based on different optimization criteria in the literature, most of them using linear heat transfer laws at the source and sink. This raises the issue how close to actual operation conditions they are, since the heat transfer law on the phase-change processes is dependent on ΔT³. This paper addresses this issue by proposing a general model for study and optimization of thermal machines with two heat reservoirs applied to a Carnot-like refrigerator, with non-linear heat transfer laws and internal and external irreversibility. The optimization was performed using First and Second Law of Thermodynamics and the Lagrange multipliers method. Thus, several constraints were imposed to the system, also different objective functions were considered, allowing finding the optimum operating conditions, as well as the limited variation ranges of the system parameters. Results show that the nature of the heat transfer laws affects the optimum values of system parameters for obtaining maximum performances and also their magnitude. Sensitivity studies with respect to system several parameters are presented. The results contribute to the understanding of the system limits in operation under different constraints and allow choosing the most convenient variables in given circumstances. Full article

Electrocardiogram (ECG) signal has been commonly used to analyze the complexity of heart rate variability (HRV). For this, various entropy methods have been considerably of interest. The multiscale entropy (MSE) method, which makes use of the sample entropy (SampEn) calculation of coarse-grained time series, has attracted attention for analysis of HRV. However, the SampEn computation may fail to be defined when the length of a time series is not enough long. Recently, distribution entropy (DistEn) with improved stability for a short-term time series has been proposed. Here, we propose a novel multiscale DistEn (MDE) for analysis of the complexity of short-term HRV by utilizing a moving-averaging multiscale process and the DistEn computation of each moving-averaged time series. Thus, it provides an improved stability of entropy evaluation for short-term HRV extracted from ECG. To verify the performance of MDE, we employ the analysis of synthetic signals and confirm the superiority of MDE over MSE. Then, we evaluate the complexity of short-term HRV extracted from ECG signals of congestive heart failure (CHF) patients and healthy subjects. The experimental results exhibit that MDE is capable of quantifying the decreased complexity of HRV with aging and CHF disease with short-term HRV time series. Full article

The microstructure, Vickers hardness, and compressive properties of novel low-activation VCrFeTa_xW_x (x = 0.1, 0.2, 0.3, 0.4, and 1) high-entropy alloys (HEAs) were studied. The alloys were fabricated by vacuum-arc melting and the characteristics of these alloys were explored. The microstructures of all the alloys exhibited a typical morphology of dendritic and eutectic structures. The VCrFeTa_0.1W_0.1 and VCrFeTa_0.2W_0.2 alloys are essentially single phase, consisting of a disordered body-centered-cubic (BCC) phase, whereas the VCrFeTa_0.2W_0.2 alloy contains fine, nanoscale precipitates distributed in the BCC matrix. The lattice parameters and compositions of the identified phases were investigated. The alloys have Vickers hardness values ranging from 546 HV_0.2 to 1135 HV_0.2 with the x ranging from 0.1 to 1, respectively. The VCrFeTa_0.1W_0.1 and VCrFeTa_0.2W_0.2 alloys exhibit compressive yield strengths of 1341 MPa and 1742 MPa, with compressive plastic strains of 42.2% and 35.7%, respectively. VCrFeTa_0.1W_0.1 and VCrFeTa_0.2W_0.2 alloys have excellent hardness after annealing for 25 h at 600–1000 °C, and presented compressive yield strength exceeding 1000 MPa with excellent heat-softening resistance at 600–800 °C. By applying the HEA criteria, Ta and W additions into the VCrFeTaW are proposed as a family of candidate materials for fusion reactors and high-temperature structural applications. Full article

Establishing policies for controlling water pollution through discharge permits creates the basis for emission permit trading. Allocating wastewater discharge permits is a prerequisite to initiating the market. Past research has focused on designing schemes to allocate discharge permits efficiently, but these schemes have ignored differences among regions in terms of emission history. This is unfortunate, as fairness may dictate that areas that have been allowed to pollute in the past will receive fewer permits in the future. Furthermore, the spatial scales of previously proposed schemes are not practical. In this article, we proposed an information entropy improved proportional allocation method, which considers differences in GDP, population, water resources, and emission history at province spatial resolution as a new way to allocate waste water emission permits. The allocation of chemical oxygen demand (COD) among 30 provinces in China is used to illustrate the proposed discharge permit distribution mechanism. In addition, we compared the pollution distribution permits obtained from the proposed allocation scheme with allocation techniques that do not consider historical pollution and with the already established country plan. Our results showed that taking into account emission history as a factor when allocating wastewater discharge permits results in a fair distribution of economic benefits. Full article

Synergy and redundancy are concepts that suggest, respectively, adaptability and fault tolerance of systems with complex behavior. This study computes redundancy/synergy in bivariate systems formed by a target X and a driver Y according to the predictive information decomposition approach and partial information decomposition framework based on the minimal mutual information principle. The two approaches assess the redundancy/synergy of past of X and Y in reducing the uncertainty of the current state of X. The methods were applied to evaluate the interactions between heart and respiration in healthy young subjects (n = 19) during controlled breathing at 10, 15 and 20 breaths/minute and in two groups of chronic heart failure patients during paced respiration at 6 (n = 9) and 15 (n = 20) breaths/minutes from spontaneous beat-to-beat fluctuations of heart period and respiratory signal. Both methods suggested that slowing respiratory rate below the spontaneous frequency increases redundancy of cardiorespiratory control in both healthy and pathological groups, thus possibly improving fault tolerance of the cardiorespiratory control. The two methods provide markers complementary to respiratory sinus arrhythmia and the strength of the linear coupling between heart period variability and respiration in describing the physiology of the cardiorespiratory reflex suitable to be exploited in various pathophysiological settings. Full article

Wireless powered communication technology has a great potential to power low-power wireless sensor networks and Internet of Things (IoT) for real-time applications in future 5G networks, where age of information (AoI) plays a very important performance metric. This paper studies the system average AoI of a wireless powered network, where a wireless-powered user harvests energy from a wireless power source (WPS) and then transmits data packets to its access point (AP) by using the harvested energy. The user generates data packets with some probability and adopts the first-come-first-served (FCFS) service policy. For such a system, by using the queuing theory and the probability models, we derive a closed-form expression of the system average AoI. We also formulate an optimization problem to minimize the AoI by optimizing the data packet generating probability, and find its solution by simple calculation and search. Simulation results demonstrate the correctness of our obtained analytical results. It also shows that, when the total distance of the two hops is fixed, the system average AoI increases linearly with the increment of the distance of the first hop, and a smaller data packet generating probability should be selected to match a bigger first-hop distance for achieving a smaller system average AoI. Moreover, a smaller data packet size also contributes to a smaller system average AoI. Full article

Image quality assessment (IQA) is a fundamental problem in image processing that aims to measure the objective quality of a distorted image. Traditional full-reference (FR) IQA methods use fixed-size sliding windows to obtain structure information but ignore the variable spatial configuration information. In order to better measure the multi-scale objects, we propose a novel IQA method, named RSEI, based on the perspective of the variable receptive field and information entropy. First, we find that consistence relationship exists between the information fidelity and human visual of individuals. Thus, we reproduce the human visual system (HVS) to semantically divide the image into multiple patches via rectangular-normalized superpixel segmentation. Then the weights of each image patches are adaptively calculated via their information volume. We verify the effectiveness of RSEI by applying it to data from the TID2008 database and denoise algorithms. Experiments show that RSEI outperforms some state-of-the-art IQA algorithms, including visual information fidelity (VIF) and weighted average deep image quality measure (WaDIQaM). Full article

Analysis of daily solar irradiation variability and predictability in space and time is important for energy resources planning, development, and management. The natural intermittency of solar irradiation is mainly triggered by atmospheric turbulent conditions, radiative transfer, optical properties of cloud and aerosol, moisture and atmospheric stability, orographic and thermal forcing, which introduce additional complexity into the phenomenological records. To address this question for daily solar irradiation data recorded during the period 2011–2015, at 32 stations measuring solar irradiance on La Reunion French tropical Indian Ocean Island, we use the tools of non-linear dynamics: the intermittency and chaos analysis, the largest Lyapunov exponent, Sample entropy, the Kolmogorov complexity and its derivatives (Kolmogorov complexity spectrum and its highest value), and spatial weighted Kolmogorov complexity combined with Hamming distance to assess complexity and corresponding predictability. Finally, we have clustered the Kolmogorov time (that quantifies the time span beyond which randomness significantly influences predictability) for daily cumulative solar irradiation for all stations. We show that under the record-breaking 2011–2012 La Nina event and preceding a very strong El-Nino 2015–2016 event, the predictability of daily incident solar energy over La Réunion is affected. Full article

Conventional quantization-based watermarking may be easily estimated by averaging on a set of watermarked signals via uniform quantization approach. Moreover, the conventional quantization-based method neglects the visual perceptual characteristics of the host signal; thus, the perceptible distortions would be introduced in some parts of host signal. In this paper, inspired by the Watson’s entropy masking model and logarithmic quantization index modulation (LQIM), a logarithmic quantization-based image watermarking method is developed by using the wavelet transform. Furthermore, the novel method improves the robustness of watermarking based on a logarithmic quantization strategy, which embeds the watermark data into the image blocks with high entropy value. The main significance of this work is that the trade-off between invisibility and robustness is simply addressed by using the logarithmic quantizaiton approach, which applies the entropy masking model and distortion-compensated scheme to develop a watermark embedding method. In this manner, the optimal quantization parameter obtained by minimizing the quantization distortion function effectively controls the watermark strength. In terms of watermark decoding, we model the wavelet coefficients of image by the generalized Gaussian distribution (GGD) and calculate the bit error probability of proposed method. Performance of the proposed method is analyzed and verified by simulation on real images. Experimental results demonstrate that the proposed method has the advantages of imperceptibility and strong robustness against attacks covering JPEG compression, additive white Gaussian noise (AWGN), Gaussian filtering, Salt&Peppers noise, scaling and rotation attack, etc. Full article

Bearing plays an important role in mechanical equipment, and its remaining useful life (RUL) prediction is an important research topic of mechanical equipment. To accurately predict the RUL of bearing, this paper proposes a data-driven RUL prediction method. First, the statistical method is used to extract the features of the signal, and the root mean square (RMS) is regarded as the main performance degradation index. Second, the correlation coefficient is used to select the statistical characteristics that have high correlation with the RMS. Then, In order to avoid the fluctuation of the statistical feature, the improved Weibull distributions (WD) algorithm is used to fit the fluctuation feature of bearing at different recession stages, which is used as input of Naive Bayes (NB) training stage. During the testing stage, the true fluctuation feature of the bearings are used as the input of NB. After the NB testing, five classes are obtained: health states and four states for bearing degradation. Finally, the exponential smoothing algorithm is used to smooth the five classes, and to predict the RUL of bearing. The experimental results show that the proposed method is effective for RUL prediction of bearing. Full article

The effects of variable thermal conductivity on heat transfer and entropy generation in a flow over a curved surface are investigated in the present study. In addition, the effects of energy dissipation and Ohmic heating are also incorporated in the modelling of the energy equation. Appropriate transformations are used to develop the self-similar equations from the governing equations of momentum and energy. The resulting self-similar equations are then solved by the Generalized Differential Quadrature Method (GDQM). For the validation and precision of the developed numerical solution, the resulting equations are also solved numerically using the Runge-Kutta-Fehlberg method (RKFM). An excellent agreement is found between the numerical results of the two methods. To examine the impacts of emerging physical parameters on velocity, temperature distribution and entropy generation, the numerical results are plotted against the various values of physical flow parameters and discussed physically in detail. Full article

The purpose of this paper is to argue against the claim that morphological computation is substantially different from other kinds of physical computation. I show that some (but not all) purported cases of morphological computation do not count as specifically computational, and that those that do are solely physical computational systems. These latter cases are not, however, specific enough: all computational systems, not only morphological ones, may (and sometimes should) be studied in various ways, including their energy efficiency, cost, reliability, and durability. Second, I critically analyze the notion of “offloading” computation to the morphology of an agent or robot, by showing that, literally, computation is sometimes not offloaded but simply avoided. Third, I point out that while the morphology of any agent is indicative of the environment that it is adapted to, or informative about that environment, it does not follow that every agent has access to its morphology as the model of its environment. Full article

To improve the low acceptance ratio and revenue to cost ratio caused by the poor match between the virtual nodes and the physical nodes in the existing virtual network embedding (VNE) algorithms, we established a multi-objective optimization integer linear programming model for the VNE problem, and proposed a novel two-stage virtual network embedding algorithm based on topology potential (VNE-TP). In the node embedding stage, the field theory once used for data clustering was introduced and a node embedding function designed to find the optimal physical node. In the link embedding stage, both the available bandwidth and hops of the candidate paths were considered, and a path embedding function designed to find the optimal path. Extensive simulation results show that the proposed algorithm outperforms other existing algorithms in terms of acceptance ratio and revenue to cost ratio. Full article

Events occurring with a frequency described by power laws, within a certain range of validity, are very common in natural systems. In many of them, it is possible to associate an energy spectrum and one can show that these types of phenomena are intimately related to Tsallis entropy $S_q$. The relevant parameters become: (i) The entropic index q, which is directly related to the power of the corresponding distribution; (ii) The ground-state energy ${\epsilon }_0$, in terms of which all energies are rescaled. One verifies that the corresponding processes take place at a temperature $T_q$ with $k{T}_q\propto {\epsilon }_0$ (i.e., isothermal processes, for a given q), in analogy with those in the class of self-organized criticality, which are known to occur at fixed temperatures. Typical examples are analyzed, like earthquakes, avalanches, and forest fires, and in some of them, the entropic index q and value of $T_q$ are estimated. The knowledge of the associated entropic form opens the possibility for a deeper understanding of such phenomena, particularly by using information theory and optimization procedures. Full article

We propose a modeling framework for magnetizable, polarizable, elastic, viscous, heat conducting, reactive mixtures in contact with interfaces. To this end, we first introduce bulk and surface balance equations that contain several constitutive quantities. For further modeling of the constitutive quantities, we formulate constitutive principles. They are based on an axiomatic introduction of the entropy principle and the postulation of Galilean symmetry. We apply the proposed formalism to derive constitutive relations in a rather abstract setting. For illustration of the developed procedure, we state an explicit isothermal material model for liquid electrolyte|metal electrode interfaces in terms of free energy densities in the bulk and on the surface. Finally, we give a survey of recent advancements in the understanding of electrochemical interfaces that were based on this model. Full article

Sixteen types of the discrete multivariate transforms, induced by the multivariate antisymmetric and symmetric sine functions, are explicitly developed. Provided by the discrete transforms, inherent interpolation methods are formulated. The four generated classes of the corresponding orthogonal polynomials generalize the formation of the Chebyshev polynomials of the second and fourth kinds. Continuous orthogonality relations of the polynomials together with the inherent weight functions are deduced. Sixteen cubature rules, including the four Gaussian, are produced by the related discrete transforms. For the three-dimensional case, interpolation tests, unitary transform matrices and recursive algorithms for calculation of the polynomials are presented. Full article