Table of Contents

Abstract: Graduation of data is of great importance in survival analysis. Smoothness and goodness of fit are two fundamental requirements in graduation. Based on the instinctive defining expression for entropy in terms of a probability distribution, two optimization models based on the Maximum Entropy Principle (MaxEnt) and Minimum Cross Entropy Principle (MinCEnt) to estimate mortality probability distributions are presented. The results demonstrate that the two approaches achieve the two basic requirements of data graduating, smoothness and goodness of fit respectively. Then, in order to achieve a compromise between these requirements, a new entropy optimization model is proposed by defining a hybrid objective function combining both principles of MaxEnt and MinCEnt models linked by a given adjustment factor which reflects the preference of smoothness and goodness of fit in the data graduation. The proposed approach is feasible and more reasonable in data graduation when both smoothness and goodness of fit are concerned.

Abstract: We derive a two-parameter family of generalized entropies, S_pq, and means m_pq. To this end, assume that we want to calculate an entropy and a mean for n non-negative real numbers {x₁,…,x_n}. For comparison, we consider {m₁,…,m_k} where m_i = m for all i = 1,…,k and where m and k are chosen such that the l^p and l^q norms of {x₁,…,x_n} and {m₁,…,m_k} coincide. We formally allow k to be real. Then, we define k, log k, and m to be a generalized cardinality k_pq, a generalized entropy S_pq, and a generalized mean m_pq respectively. We show that this family of entropies includes the Shannon and Rényi entropies and that the family of generalized means includes the power means (such as arithmetic, harmonic, geometric, root-mean-square, maximum, and minimum) as well as novel means of Shannon-like and Rényi-like forms. A thermodynamic interpretation arises from the fact that the l^p norm is closely related to the partition function at inverse temperature β = p. Namely, two systems possess the same generalized entropy and generalized mean energy if and only if their partition functions agree at two temperatures, which is also equivalent to the condition that their Helmholtz free energies agree at these two temperatures.

Abstract: Bearing fault diagnosis has attracted significant attention over the past few decades. It consists of two major parts: vibration signal feature extraction and condition classification for the extracted features. In this paper, multiscale permutation entropy (MPE) was introduced for feature extraction from faulty bearing vibration signals. After extracting feature vectors by MPE, the support vector machine (SVM) was applied to automate the fault diagnosis procedure. Simulation results demonstrated that the proposed method is a very powerful algorithm for bearing fault diagnosis and has much better performance than the methods based on single scale permutation entropy (PE) and multiscale entropy (MSE).

Abstract: The paradigm shift from an exclusive allocation of frequency bands, one for each system, to a shared use of frequencies comes along with the need of new concepts since interference will be an ubiquitous phenomenon. In this paper, we use the concept of arbitrarily varying channels to model the impact of unknown interference caused by coexisting wireless systems which operate on the same frequencies. Within this framework, capacity can be zero if pre-specified encoders and decoders are used. This necessitates the use of more sophisticated coordination schemes where the choice of encoders and decoders is additionally coordinated based on common randomness. As an application we study the arbitrarily varying bidirectional broadcast channel and derive the capacity regions for different coordination strategies. This problem is motivated by decode-and-forward bidirectional or two-way relaying, where a relay establishes a bidirectional communication between two other nodes while sharing the resources with other coexisting wireless networks.

Abstract: In reviewing the literature pertaining to interfacial water, colloidal stability, and cell membrane function, we are led to propose that a cascade of events that begins with acute exogenous surfactant-induced interfacial water stress can explain the etiology of sudden death syndrome (SDS), as well as many other diseases associated with modern times. A systemic lowering of serum zeta potential mediated by exogenous cationic surfactant administration is the common underlying pathophysiology. The cascade leads to subsequent inflammation, serum sickness, thrombohemorrhagic phenomena, colloidal instability, and ultimately even death. We propose that a sufficient precondition for sudden death is lowered bioavailability of certain endogenous sterol sulfates, sulfated glycolipids, and sulfated glycosaminoglycans, which are essential in maintaining biological equipose, energy metabolism, membrane function, and thermodynamic stability in living organisms. Our literature review provides the basis for the presentation of a novel hypothesis as to the origin of endogenous bio-sulfates which involves energy transduction from sunlight. Our hypothesis is amply supported by a growing body of data showing that parenteral administration of substances that lower serum zeta potential results in kosmotropic cationic and/or chaotropic anionic interfacial water stress, and the resulting cascade.

Abstract: Discovering the mechanism that controls the three-dimensional structures of proteins, which are closely related to their biological functions, remains a challenge in modern biological science, even for small proteins. From a thermodynamic viewpoint, the native structure of a protein can be understood as the global minimum of the free energy landscape of the protein-water system. However, it is still difficult to describe the energetics of protein stability in an effective manner. Recently, our group developed a free energy function with an all-atomic description for a protein that focuses on hydration thermodynamics. The validity of the function was examined using structural decoy sets that provide numerous misfolded “non-native” structures. For all targeted sets, the function was able to identify the experimentally determined native structure as the best structure. The energy function can also be used to calculate the binding free energy of a protein with ligands. I review the physicochemical theories employed in the development of the free energy function and recent studies evaluating protein structure stability and protein-ligand binding affinities that use this function.

Abstract: Recently the identity of de Bruijn type between the relative entropy and the relative Fisher information with the reference moving has been unveiled by Verdú via MMSE in estimation theory. In this paper, we shall give another proof of this identity in more direct way that the derivative is calculated by applying integrations by part with the heat equation. We shall also derive an integral representation of the relative entropy, as one of the applications of which the logarithmic Sobolev inequality for centered Gaussian measures will be given.

Abstract: Abstract: This article first introduces the concept of wavelet q-Fisher information and then derives a closed-form expression of this quantifier for scaling signals of parameter α. It is shown that this information measure appropriately describes the complexities of scaling signals and provides further analysis flexibility with the parameter q. In the limit of q → 1, wavelet q-Fisher information reduces to the standard wavelet Fisher information and for q > 2 it reverses its behavior. Experimental results on synthesized fGn signals validates the level-shift detection capabilities of wavelet q-Fisher information. A comparative study also shows that wavelet q-Fisher information locates structural changes in correlated and anti-correlated fGn signals in a way comparable with standard breakpoint location techniques but at a fraction of the time. Finally, the application of this quantifier to H.263 encoded video signals is presented.

Abstract: Energy storage systems are increasingly gaining importance with regard to their role in achieving load levelling, especially for matching intermittent sources of renewable energy with customer demand, as well as for storing excess nuclear or thermal power during the daily cycle. Compressed air energy storage (CAES), with its high reliability, economic feasibility, and low environmental impact, is a promising method for large-scale energy storage. Although there are only two large-scale CAES plants in existence, recently, a number of CAES projects have been initiated around the world, and some innovative concepts of CAES have been proposed. Existing CAES plants have some disadvantages such as energy loss due to dissipation of heat of compression, use of fossil fuels, and dependence on geological formations. This paper reviews the main drawbacks of the existing CAES systems and presents some innovative concepts of CAES, such as adiabatic CAES, isothermal CAES, micro-CAES combined with air-cycle heating and cooling, and constant-pressure CAES combined with pumped hydro storage that can address such problems and widen the scope of CAES applications, by energy and exergy analyses. These analyses greatly help us to understand the characteristics of each CAES system and compare different CAES systems.

Abstract: The discrete Shannon entropy H was formulated only to measure indeterminacy effected through a set of probabilities, but the indeterminacy in a real-valued discrete variable depends on both the allowed outcomes x and the corresponding probabilities Þ. A fundamental measure that is sensitive to both x and p is derived here from the total differential entropy of a continuous real variable and its conjugate in the discrete limit, where the conjugate is universally eliminated. The asymptotic differential entropy recovers H plus the new measure, named ≡, which provides a novel probe of intrinsic organization in sequences of real numbers.

Abstract: In this paper we undertake the theoretical analysis of a two-stage semiconductor thermoelectric module (TEM) which contains an arbitrary and different number of thermocouples, n₁ and n₂, in each stage (pyramid-styled TEM). The analysis is based on a dimensionless entropy balance set of equations. We study the effects of n₁ and n₂, the flowing electric currents through each stage, the applied temperatures and the thermoelectric properties of the semiconductor materials on the exergetic efficiency. Our main result implies that the electric currents flowing in each stage must necessarily be different with a ratio about 4.3 if the best thermal performance and the highest temperature difference possible between the cold and hot side of the device are pursued. This fact had not been pointed out before for pyramid-styled two stage TEM. The ratio n₁/n₂ should be about 8.

Abstract: Entropy is a powerful tool for the analysis of time series, as it allows describing the probability distributions of the possible state of a system, and therefore the information encoded in it. Nevertheless, important information may be codified also in the temporal dynamics, an aspect which is not usually taken into account. The idea of calculating entropy based on permutation patterns (that is, permutations defined by the order relations among values of a time series) has received a lot of attention in the last years, especially for the understanding of complex and chaotic systems. Permutation entropy directly accounts for the temporal information contained in the time series; furthermore, it has the quality of simplicity, robustness and very low computational cost. To celebrate the tenth anniversary of the original work, here we analyze the theoretical foundations of the permutation entropy, as well as the main recent applications to the analysis of economical markets and to the understanding of biomedical systems.

Abstract: We develop the general reconstruction scheme in two scalar model. The quintom-like theory which may describe (different) non-singular Little Rip or de Sitter cosmology is reconstructed. The number of scalar phantom dark energy models (with Little Rip cosmology or asymptotically de Sitter evolution) is presented. Stability issue of such dark energy cosmologies as well as the flow to fixed points are studied. The stability of Little Rip universe which leads to dissolution of bound objects sometime in future indicates that no classical transition to de Sitter space occurs. The possibility of unification of inflation with Little Rip dark energy in two scalar theory is briefly mentioned.