Entropy — Open Access Journal

Information is the fundamental currency of naturally occurring complex adaptive systems, whether they are individual organisms or collective social insect colonies. Information appears to be more important than energy in determining the behavior of these systems. However, it is not the quantity of information but rather its salience or meaning which is significant. Salience is not, in general, associated with instantaneous events but rather with spatio-temporal transients of events. This requires a shift in theoretical focus from instantaneous states towards spatio-temporal transients as the proper object for studying information flow in naturally occurring complex adaptive systems. A primitive form of salience appears in simple complex systems models in the form of transient induced global response synchronization (TIGoRS). Sparse random samplings of spatio-temporal transients may induce stable collective responses from the system, establishing a stimulus–response relationship between the system and its environment, with the system parsing its environment into salient and non-salient stimuli. In the presence of TIGoRS, an embedded complex dynamical system becomes a primitive automaton, modeled as a Sulis machine. Full article

This paper employs Bayesian probability theory for analyzing data generated in femtosecond pump-probe photoelectron-photoion coincidence (PEPICO) experiments. These experiments allow investigating ultrafast dynamical processes in photoexcited molecules. Bayesian probability theory is consistently applied to data analysis problems occurring in these types of experiments such as background subtraction and false coincidences. We previously demonstrated that the Bayesian formalism has many advantages, amongst which are compensation of false coincidences, no overestimation of pump-only contributions, significantly increased signal-to-noise ratio, and applicability to any experimental situation and noise statistics. Most importantly, by accounting for false coincidences, our approach allows running experiments at higher ionization rates, resulting in an appreciable reduction of data acquisition times. In addition to our previous paper, we include fluctuating laser intensities, of which the straightforward implementation highlights yet another advantage of the Bayesian formalism. Our method is thoroughly scrutinized by challenging mock data, where we find a minor impact of laser fluctuations on false coincidences, yet a noteworthy influence on background subtraction. We apply our algorithm to data obtained in experiments and discuss the impact of laser fluctuations on the data analysis. Full article

We show how to sample exactly discrete probability distributions whose defining parameters are distributed among remote parties. For this purpose, von Neumann’s rejection algorithm is turned into a distributed sampling communication protocol. We study the expected number of bits communicated among the parties and also exhibit a trade-off between the number of rounds of the rejection algorithm and the number of bits transmitted in the initial phase. Finally, we apply remote sampling to the simulation of quantum entanglement in its essentially most general form possible, when an arbitrary finite number m of parties share systems of arbitrary finite dimensions on which they apply arbitrary measurements (not restricted to being projective measurements, but restricted to finitely many possible outcomes). In case the dimension of the systems and the number of possible outcomes per party are bounded by a constant, it suffices to communicate an expected $O\left(m^2\right)$ bits in order to simulate exactly the outcomes that these measurements would have produced on those systems. Full article

A software bug is characterized by its attributes. Various prediction models have been developed using these attributes to enhance the quality of software products. The reporting of bugs leads to high irregular patterns. The repository size is also increasing with enormous rate, resulting in uncertainty and irregularities. These uncertainty and irregularities are termed as veracity in the context of big data. In order to quantify these irregular and uncertain patterns, the authors have appliedentropy-based measures of the terms reported in the summary and the comments submitted by the users. Both uncertainties and irregular patterns have been taken care of byentropy-based measures. In this paper, the authors considered that the bug fixing process does not only depend upon the calendar time, testing effort and testing coverage, but it also depends on the bug summary description and comments. The paper proposed bug dependency-based mathematical models by considering the summary description of bugs and comments submitted by users in terms of the entropy-based measures. The models were validated on different Eclipse project products. The models proposed in the literature have different types of growth curves. The models mainly follow exponential, S-shaped or mixtures of both types of curves. In this paper, the proposed models were compared with the modelsfollowingexponential, S-shaped and mixtures of both types of curves. Full article

Pressure ulcers are one of the most common complications of a spinal cord injury (SCI). Prolonged unrelieved pressure is thought to be the primary causative factor resulting in tissue ischemia and eventually pressure ulcers. Previous studies suggested that local cooling reduces skin ischemia of the compressed soft tissues based on smaller hyperemic responses. However, the effect of local cooling on nonlinear properties of skin blood flow (SBF) during hyperemia is unknown. In this study, 10 wheelchair users with SCI and 10 able-bodied (AB) controls underwent three experimental protocols, each of which included a 10-min period as baseline, a 20-min intervention period, and a 20-min period for recovering SBF. SBF was measured using a laser Doppler flowmetry. During the intervention period, a pressure of 60 mmHg was applied to the sacral skin, while three skin temperature settings were tested, including no temperature change, a decrease by 10 °C, and an increase by 10 °C, respectively. A multiscale entropy (MSE) method was employed to quantify the degree of regularity of blood flow oscillations (BFO) associated with the SBF control mechanisms during baseline and reactive hyperemia. The results showed that under pressure with cooling, skin BFO both in people with SCI and AB controls were more regular at multiple time scales during hyperemia compared to baseline, whereas under pressure with no temperature change and particularly pressure with heating, BFO were more irregular during hyperemia compared to baseline. Moreover, the results of surrogate tests indicated that changes in the degree of regularity of BFO from baseline to hyperemia were only partially attributed to changes in relative amplitudes of endothelial, neurogenic, and myogenic components of BFO. These findings support the use of MSE to assess the efficacy of local cooling on reactive hyperemia and assess the degree of skin ischemia in people with SCI. Full article

This work studies mixtures of probability measures on ${\mathbb{R}}^n$ and gives bounds on the Poincaré and the log–Sobolev constants of two-component mixtures provided that each component satisfies the functional inequality, and both components are close in the ${\chi }^2$-distance. The estimation of those constants for a mixture can be far more subtle than it is for its parts. Even mixing Gaussian measures may produce a measure with a Hamiltonian potential possessing multiple wells leading to metastability and large constants in Sobolev type inequalities. In particular, the Poincaré constant stays bounded in the mixture parameter, whereas the log–Sobolev may blow up as the mixture ratio goes to 0 or 1. This observation generalizes the one by Chafaï and Malrieu to the multidimensional case. The behavior is shown for a class of examples to be not only a mere artifact of the method. Full article

Relations between common information measures include the duality relations based on Möbius inversion on lattices, which are the direct consequence of the symmetries of the lattices of the sets of variables (subsets ordered by inclusion). In this paper we use the lattice and functional symmetries to provide a unifying formalism that reveals some new relations and systematizes the symmetries of the information functions. To our knowledge, this is the first systematic examination of the full range of relationships of this class of functions. We define operators on functions on these lattices based on the Möbius inversions that map functions into one another, which we call Möbius operators, and show that they form a simple group isomorphic to the symmetric group S₃. Relations among the set of functions on the lattice are transparently expressed in terms of the operator algebra, and, when applied to the information measures, can be used to derive a wide range of relationships among diverse information measures. The Möbius operator algebra is then naturally generalized which yields an even wider range of new relationships. Full article

We carry out a thought experiment in an imaginary world. Our world is both local and realistic, yet it violates a Bell inequality more than does quantum theory. This serves to debunk the myth that equates local realism with local hidden variables in the simplest possible manner. Along the way, we reinterpret the celebrated 1935 argument of Einstein, Podolsky and Rosen, and come to the conclusion that they were right in their questioning the completeness of the Copenhagen version of quantum theory, provided one believes in a local-realistic universe. Throughout our journey, we strive to explain our views from first principles, without expecting mathematical sophistication nor specialized prior knowledge from the reader. Full article

We study the localization properties of the eigenvectors, characterized by their information entropy, of tight-binding random networks with balanced losses and gain. The random network model, which is based on Erdős–Rényi (ER) graphs, is defined by three parameters: the network size N, the network connectivity $\alpha$, and the losses-and-gain strength $\gamma$. Here, N and $\alpha$ are the standard parameters of ER graphs, while we introduce losses and gain by including complex self-loops on all vertices with the imaginary amplitude i$\gamma$ with random balanced signs, thus breaking the Hermiticity of the corresponding adjacency matrices and inducing complex spectra. By the use of extensive numerical simulations, we define a scaling parameter $\xi \equiv \xi (N,\alpha ,\gamma )$ that fixes the localization properties of the eigenvectors of our random network model; such that, when $\xi <0.1$ ($10<\xi$), the eigenvectors are localized (extended), while the localization-to-delocalization transition occurs for $0.1<\xi <10$. Moreover, to extend the applicability of our findings, we demonstrate that for fixed $\xi$, the spectral properties (characterized by the position of the eigenvalues on the complex plane) of our network model are also universal; i.e., they do not depend on the specific values of the network parameters. Full article

External chemical reactors for steam reforming and water gas shift reactions are needed for a proton exchange membrane (PEM) fuel cell system using syngas fuel. For the preheating of syngas and stable steam reforming reaction at 600 °C, residual hydrogen from a fuel cell and a certain amount of additional syngas are burned. The combustion temperature is calculated and the molar ratio of the syngas into burner and steam reformer is determined. Based on thermodynamics and electrochemistry, the electric power density and energy conversion efficiency of a PEM fuel cell based syngas are expressed. The effects of the temperature, the hydrogen utilization factor at the anode, and the molar ratio of the syngas into burner and steam reformer on the performance of a PEM fuel cell are discussed. To achieve the maximum power density or efficiency, the key parameters are determined. This manuscript presents the detailed operating process of a PEM fuel cell, the allocation of the syngas for combustion and electric generation, and the feasibility of a PEM fuel cell using syngas. Full article

For future sustainable seawater desalination, the importance of achieving better energy efficiency of the existing 19,500 commercial-scale desalination plants cannot be over emphasized. The major concern of the desalination industry is the inadequate approach to energy efficiency evaluation of diverse seawater desalination processes by omitting the grade of energy supplied. These conventional approaches would suffice if the efficacy comparison were to be conducted for the same energy input processes. The misconception of considering all derived energies as equivalent in the desalination industry has severe economic and environmental consequences. In the realms of the energy and desalination system planners, serious judgmental errors in the process selection of green installations are made unconsciously as the efficacy data are either flawed or inaccurate. Inferior efficacy technologies’ implementation decisions were observed in many water-stressed countries that can burden a country’s economy immediately with higher unit energy cost as well as cause more undesirable environmental effects on the surroundings. In this article, a standard primary energy-based thermodynamic framework is presented that addresses energy efficacy fairly and accurately. It shows clearly that a thermally driven process consumes 2.5–3% of standard primary energy (SPE) when combined with power plants. A standard universal performance ratio-based evaluation method has been proposed that showed all desalination processes performance varies from 10–14% of the thermodynamic limit. To achieve 2030 sustainability goals, innovative processes are required to meet 25–30% of the thermodynamic limit. Full article

The reconstruction of positron emission tomography data is a difficult task, particularly at low count rates because Poisson noise has a significant influence on the statistical uncertainty of positron emission tomography (PET) measurements. Prior information is frequently used to improve image quality. In this paper, we propose the use of a field of experts to model a priori structure and capture anatomical spatial dependencies of the PET images to address the problems of noise and low count data, which make the reconstruction of the image difficult. We reconstruct PET images by using a modified MXE algorithm, which minimizes a objective function with the cross-entropy as a fidelity term, while the field of expert model is incorporated as a regularizing term. Comparisons with the expectation maximization algorithm and a iterative method with a prior penalizing relative differences showed that the proposed method can lead to accurate estimation of the image, especially with acquisitions at low count rate. Full article

Motivated by the Carleo’s work (Science, 2017, 355: 602), we focus on finding the neural network quantum statesapproximation of the unknown ground state of a given Hamiltonian H in terms of the best relative error and explore the influences of sum, tensor product, local unitary of Hamiltonians on the best relative error. Besides, we illustrate our method with some examples. Full article

Partial discharge (PD) fault analysis is an important tool for insulation condition diagnosis of electrical equipment. In order to conquer the limitations of traditional PD fault diagnosis, a novel feature extraction approach based on variational mode decomposition (VMD) and multi-scale dispersion entropy (MDE) is proposed. Besides, a hypersphere multiclass support vector machine (HMSVM) is used for PD pattern recognition with extracted PD features. Firstly, the original PD signal is decomposed with VMD to obtain intrinsic mode functions (IMFs). Secondly proper IMFs are selected according to central frequency observation and MDE values in each IMF are calculated. And then principal component analysis (PCA) is introduced to extract effective principle components in MDE. Finally, the extracted principle factors are used as PD features and sent to HMSVM classifier. Experiment results demonstrate that, PD feature extraction method based on VMD-MDE can extract effective characteristic parameters that representing dominant PD features. Recognition results verify the effectiveness and superiority of the proposed PD fault diagnosis method. Full article

We propose a schematic setup of quantum key distribution (QKD) with an improved secret key rate based on high-dimensional quantum states. Two degrees-of-freedom of a single photon, orbital angular momentum modes, and multi-path modes, are used to encode secret key information. Its practical implementation consists of optical elements that are within the reach of current technologies such as a multiport interferometer. We show that the proposed feasible protocol has improved the secret key rate with much sophistication compared to the previous 2-dimensional protocol known as the detector-device-independent QKD. Full article

Nonlinear dynamical analysis is a powerful approach to understanding biological systems. One of the most used metrics of system complexities is the Kolmogorov entropy. Long input signals without noise are required for the calculation, which are very hard to obtain in real situations. Techniques allowing the estimation of entropy directly from time signals are statistics like approximate and sample entropy. Based on that, the new measurement for quaternion signal is introduced. This work presents an example of application of a nonlinear time series analysis by using the new quaternion, approximate entropy to analyse human gait kinematic data. The quaternion entropy was applied to analyse the quaternion signal which represents the segments orientations in time during the human gait. The research was aimed at the assessment of the influence of both walking speed and ground slope on the gait control during treadmill walking. Gait data was obtained by the optical motion capture system. Full article

Uncertainty assessment techniques have been extensively applied as an estimate of accuracy to compensate for weaknesses with traditional approaches. Traditional approaches to mapping accuracy assessment have been based on a confusion matrix, and hence are not only dependent on the availability of test data but also incapable of capturing the spatial variation in classification error. Here, we apply and compare two uncertainty assessment techniques that do not rely on test data availability and enable the spatial characterisation of classification accuracy before the validation phase, promoting the assessment of error propagation within the classified imagery products. We compared the performance of emerging deep neural network (DNN) with the popular random forest (RF) technique. Uncertainty assessment was implemented by calculating the Shannon entropy of class probabilities predicted by DNN and RF for every pixel. The classification uncertainties of DNN and RF were quantified for two different hyperspectral image datasets—Salinas and Indian Pines. We then compared the uncertainty against the classification accuracy of the techniques represented by a modified root mean square error (RMSE). The results indicate that considering modified RMSE values for various sample sizes of both datasets, the derived entropy based on the DNN algorithm is a better estimate of classification accuracy and hence provides a superior uncertainty estimate at the pixel level. Full article

Maximum entropy principle (MEP) analysis with few non-zero effective interactions successfully characterizes the distribution of dynamical states of pulse-coupled networks in many fields, e.g., in neuroscience. To better understand the underlying mechanism, we found a relation between the dynamical structure, i.e., effective interactions in MEP analysis, and the anatomical coupling structure of pulse-coupled networks and it helps to understand how a sparse coupling structure could lead to a sparse coding by effective interactions. This relation quantitatively displays how the dynamical structure is closely related to the anatomical coupling structure. Full article