Entropy

This paper introduces a novel three-parameter invertible bimodal Gumbel distribution, addressing the need for a versatile statistical tool capable of simultaneously modeling maximum and minimum extremes in various fields such as hydrology, meteorology, finance, and insurance. Unlike previous bimodal Gumbel distributions available in the literature, our proposed model features a simple closed-form cumulative distribution function, enhancing its computational attractiveness and applicability. This paper elucidates the behavior and advantages of the invertible bimodal Gumbel distribution through detailed mathematical formulations, graphical illustrations, and exploration of distributional characteristics. We illustrate using financial data to estimate Value at Risk (VaR) from our suggested model, considering maximum and minimum blocks simultaneously. Full article

Measurements of systems taken along a continuous functional dimension, such as time or space, are ubiquitous in many fields, from the physical and biological sciences to economics and engineering. Such measurements can be viewed as realisations of an underlying smooth process sampled over the continuum. However, traditional methods for independence testing and causal learning are not directly applicable to such data, as they do not take into account the dependence along the functional dimension. By using specifically designed kernels, we introduce statistical tests for bivariate, joint, and conditional independence for functional variables. Our method not only extends the applicability to functional data of the Hilbert–Schmidt independence criterion (hsic) and its d-variate version (d-hsic), but also allows us to introduce a test for conditional independence by defining a novel statistic for the conditional permutation test (cpt) based on the Hilbert–Schmidt conditional independence criterion (hscic), with optimised regularisation strength estimated through an evaluation rejection rate. Our empirical results of the size and power of these tests on synthetic functional data show good performance, and we then exemplify their application to several constraint- and regression-based causal structure learning problems, including both synthetic examples and real socioeconomic data. Full article

Living organisms are active open systems far from thermodynamic equilibrium. The ability to behave actively corresponds to dynamical metastability: minor but supercritical internal or external effects may trigger major substantial actions such as gross mechanical motion, dissipating internally accumulated energy reserves. Gaining a selective advantage from the beneficial use of activity requires a consistent combination of sensual perception, memorised experience, statistical or causal prediction models, and the resulting favourable decisions on actions. This information processing chain originated from mere physical interaction processes prior to life, here denoted as structural information exchange. From there, the self-organised transition to symbolic information processing marks the beginning of life, evolving through the novel purposivity of trial-and-error feedback and the accumulation of symbolic information. The emergence of symbols and prediction models can be described as a ritualisation transition, a symmetry-breaking kinetic phase transition of the second kind previously known from behavioural biology. The related new symmetry is the neutrally stable arbitrariness, conventionality, or code invariance of symbols with respect to their meaning. The meaning of such symbols is given by the structural effect they ultimately unleash, directly or indirectly, by deciding on which actions to take. The early genetic code represents the first symbols. The genetically inherited symbolic information is the first prediction model for activities sufficient for survival under the condition of environmental continuity, sometimes understood as the “final causality” property of the model. Full article

As cross-border access becomes more frequent, traditional perimeter-based network security models can no longer cope with evolving security requirements. Zero trust is a novel paradigm for cybersecurity based on the core concept of “never trust, always verify”. It attempts to protect against security risks related to internal threats by eliminating the demarcations between the internal and external network of traditional network perimeters. Nevertheless, research on the theory and application of zero trust is still in its infancy, and more extensive research is necessary to facilitate a deeper understanding of the paradigm in academia and the industry. In this paper, trust in cybersecurity is discussed, following which the origin, concepts, and principles related to zero trust are elaborated on. The characteristics, strengths, and weaknesses of the existing research are analysed in the context of zero trust achievements and their technical applications in Cloud and IoT environments. Finally, to support the development and application of zero trust in the future, the concept and its current challenges are analysed. Full article

The paper proposes a novel artificial noise (AN) injection strategy in multiple-input single-output multiple-antenna-eavesdropper (MISOME) systems under imperfect channel estimation at the legitimate channel to achieve zero secrecy outage probability under any circumstance. The zero secrecy outage is proved to always be achievable regardless of the eavesdropper’s number of antennas or location when the pair secrecy and codeword rates are chosen properly. The results show that when there is perfect channel state information, the zero-outage secrecy throughput increases with the transmit power, which is important for secrecy design. Additionally, an analysis of the secrecy throughput and secrecy energy efficiency gives further insight into the effectiveness of the proposed scheme. Full article

We first report that the solar flare time sequence exhibits a fluctuation characterized by its power spectral density being inversely proportional to the signal frequency. This is the 1/f fluctuation, or pink noise, observed ubiquitously in nature. Using GOES16 data, we found that low-energy flares ($E\le E_{mean}$) display 1/f fluctuations, whereas high-energy flares ($E>E_{mean}$) show a flat spectrum. Furthermore, we found that the timing sequence of the flares reveals clearer 1/f fluctuations. These observations suggest that the solar flare 1/f fluctuations are associated with low-energy phenomena. We investigated the origin of these 1/f fluctuations based on our recent hypothesis: 1/f fluctuations arise from amplitude modulation and demodulation. We propose that this amplitude modulation is encoded by the resonance with the solar five-minute oscillation (SFO) and demodulated by magnetic reconnections. We partially demonstrate this scenario by analyzing the SFO eigenmodes resolving the frequency degeneration in the azimuthal order number m using the solar rotation and resonance. Given the robust nature of 1/f fluctuations, we speculated that the solar flare 1/f fluctuations may be inherited by the various phenomena around the Sun, such as the sunspot numbers and cosmic rays. In addition, we draw parallels between solar flares and earthquakes, both exhibiting 1/f fluctuations. Interestingly, the analysis applied to solar flares can also be adapted to earthquakes if we read the SFO as Earth’s free oscillation and magnetic reconnections as fault ruptures. Moreover, we point out the possibility that the same analysis also applies to the activity of a black hole/disk system if we read the SFO as the quasi-periodic oscillation of a black hole. Full article

Random pulse computing (RPC), the third paradigm along with digital and quantum computing, draws inspiration from biology, particularly the functioning of neurons. Here, we study information processing in random pulse computing circuits intended for the summation of numbers. Based on the information-theoretic merits of entropy budget and relative Kolmogorov–Sinai entropy, we investigate the prior art and propose new circuits: three deterministic adders with significantly improved output entropy and one exact nondeterministic adder that requires much less additional entropy than the previous art. All circuits are realized and tested experimentally, using quantum entropy sources and reconfigurable logic devices. Not only the proposed circuits yield a precise mathematical result and have output entropy near maximum, which satisfies the need for building a programmable random pulse computer, but also they provide affordable hardware options for generating additional entropy. Full article

This paper proposes a new string transformation technique called Move with Interleaving (MwI). Four possible ways of rearranging 2D raster images into 1D sequences of values are applied, including scan-line, left-right, strip-based, and Hilbert arrangements. Experiments on 32 benchmark greyscale raster images of various resolutions demonstrated that the proposed transformation reduces information entropy to a similar extent as the combination of the Burrows–Wheeler transform followed by the Move-To-Front or the Inversion Frequencies. The proposed transformation MwI yields the best result among all the considered transformations when the Hilbert arrangement is applied. Full article

The presence of information asymmetry can hinder the public’s ability to make well-informed decisions, resulting in unwarranted suspicion and the widespread dissemination of rumors. Therefore, it is crucial to provide individuals with consistent and dependable scientific education. Regular popular science education is considered a periodic impulsive intervention to mitigate the impact of information asymmetry and promote a more informed and discerning public. Drawing on these findings, this paper proposes a susceptible-hesitant-infected-refuting-recovered (SHIDR) rumor-spreading model to explain the spread of rumors. The model incorporates elements such as time delay, nonlinear incidence, and refuting individuals. Firstly, by applying the comparison theorem of an impulsive differential equation, we calculate two thresholds for rumor propagation. Additionally, we analyze the conditions of global attractiveness of the rumor-free periodic solution. Furthermore, we consider the condition for the rumor’s permanence. Finally, numerical simulations are conducted to validate the accuracy of our findings. The results suggest that increasing the proportion of impulsive vaccination, reducing the impulsive period, or prolonging the delay time can effectively suppress rumors. Full article

We investigated the impact of nonequilibrium conditions on the transmission and recovery of information through noisy channels. By measuring the recoverability of messages from an information source, we demonstrate that the ability to recover information is connected to the nonequilibrium behavior of the information flow, particularly in terms of sequential information transfer. We discovered that the mathematical equivalence of information recoverability and entropy production characterizes the dissipative nature of information transfer. Our findings show that both entropy production (or recoverability) and mutual information increase monotonically with the nonequilibrium strength of information dynamics. These results suggest that the nonequilibrium dissipation cost can enhance the recoverability of noise messages and improve the quality of information transfer. Finally, we propose a simple model to test our conclusions and found that the numerical results support our findings. Full article

Point cloud completion aims to generate high-resolution point clouds using incomplete point clouds as input and is the foundational task for many 3D visual applications. However, most existing methods suffer from issues related to rough localized structures. In this paper, we attribute these problems to the lack of attention to local details in the global optimization methods used for the task. Thus, we propose a new model, called PA-NET, to guide the network to pay more attention to local structures. Specifically, we first use textual embedding to assist in training a robust point assignment network, enabling the transformation of global optimization into the co-optimization of local and global aspects. Then, we design a novel plug-in module using the assignment network and introduce a new loss function to guide the network’s attention towards local structures. Numerous experiments were conducted, and the quantitative results demonstrate that our method achieves novel performance on different datasets. Additionally, the visualization results show that our method efficiently resolves the issue of poor local structures in the generated point cloud. Full article

Persistent homology is a natural tool for probing the topological characteristics of weighted graphs, essentially focusing on their 0-dimensional homology. While this area has been thoroughly studied, we present a new approach to constructing a filtration for cluster analysis via persistent homology. The key advantages of the new filtration is that (a) it provides richer signatures for connected components by introducing non-trivial birth times, and (b) it is robust to outliers. The key idea is that nodes are ignored until they belong to sufficiently large clusters. We demonstrate the computational efficiency of our filtration, its practical effectiveness, and explore into its properties when applied to random graphs. Full article

Utilizing the Modified Hagedorn function with embedded flow, we analyze the transverse momenta ($p_T$) and transverse mass ($m_T$) spectra of ${\pi }^{+}$ in Au–Au, Cu–Cu, and d–Au collisions at $\sqrt{s_{NN}}$ = 200 GeV across various centrality bins. Our study reveals the centrality and system size dependence of key freezeout parameters, including kinetic freezeout temperature $\left(T_0\right)$, transverse flow velocity $\left({\beta }_T\right)$, entropy-related parameter $\left(n\right)$, and kinetic freezeout volume (V). Specifically, $T_0$ and n increase from central to peripheral collisions, while ${\beta }_T$ and V show the opposite trend. These parameters also exhibit system size dependence; $T_0$ and ${\beta }_T$ are smaller in larger collision systems, whereas V is larger. Importantly, central collisions correspond to a stiffer Equation of State (EOS), characterized by larger ${\beta }_T$ and smaller $T_0$, while peripheral collisions indicate a softer EOS. These insights are crucial for understanding the properties of Quark–Gluon Plasma (QGP) and offer valuable constraints for Quantum Chromodynamics (QCD) models at high temperatures and densities. Full article

In this work, we analyse a common-pool resource game with homogeneous players (both have boundedly rational expectations) and entanglement between players’ strategies. The quantum model with homogeneous expectations is a differential approach to the game since, to the best of our knowledge, it has hardly been considered in previous works. The game is represented using a Cournot type payoff functions, limited to the maximum capacity of the resource. The behaviour of the dynamics is studied considering how the fixed points (particularly the Nash equilibrium) and the stability of the system vary depending on the different values of the parameters involved in the model. In the analysis of this game, it is especially relevant to consider the extent to which the resource is exploited, since the output of the players is highly affected by this issue. It is studied in which cases the resource can be overexploited, adjusting the parameters of the model to avoid this scenario when it is possible. The results are obtained from an analytical point of view and also graphically using bifurcation diagrams to show the behaviour of the dynamics. Full article

We describe boson sampling of interacting atoms from the noncondensed fraction of Bose–Einstein-condensed (BEC) gas confined in a box trap as a new platform for studying computational ♯P-hardness and quantum supremacy of many-body systems. We calculate the characteristic function and statistics of atom numbers via the newly found Hafnian master theorem. Using Bloch–Messiah reduction, we find that interatomic interactions give rise to two equally important entities—eigen-squeeze modes and eigen-energy quasiparticles—whose interplay with sampling atom states determines the behavior of the BEC gas. We infer that two necessary ingredients of ♯P-hardness, squeezing and interference, are self-generated in the gas and, contrary to Gaussian boson sampling in linear interferometers, external sources of squeezed bosons are not required. Full article

Thermoelectric (TE) waste heat recovery has attracted significant attention over the past decades, owing to its direct heat-to-electricity conversion capability and reliable operation. However, methods for application-specific, system-level TE design have not been thoroughly investigated. This work provides detailed design optimization strategies and exergy analysis for TE waste heat recovery systems. To this end, we propose the use of TE system equipped on the exhaust of a gas turbine power plant for exhaust waste heat recovery and use it as a case study. A numerical tool has been developed to solve the coupled charge and heat current equations with temperature-dependent material properties and convective heat transfer at the interfaces with the exhaust gases at the hot side and with the ambient air at the heat sink side. Our calculations show that at the optimum design with 50% fill factor and 6 mm leg thickness made of state-of-the-art Bi₂Te₃ alloys, the proposed system can reach power output of 10.5 kW for the TE system attached on a 2 m-long, 0.5 × 0.5 m²-area exhaust duct with system efficiency of 5% and material cost per power of 0.23 $/W. Our extensive exergy analysis reveals that only 1% of the exergy content of the exhaust gas is exploited in this heat recovery process and the exergy efficiency of the TE system can reach 8% with improvement potential of 85%. Full article

Wearable technologies face challenges due to signal instability, hindering their usage. Thus, it is crucial to comprehend the connection between dynamic patterns in photoplethysmography (PPG) signals and cardiovascular health. In our study, we collected 401 multimodal recordings from two public databases, evaluating hemodynamic conditions like blood pressure (BP), cardiac output (CO), vascular compliance (C), and peripheral resistance (R). Using irregular-resampling auto-spectral analysis (IRASA), we quantified chaotic components in PPG signals and employed different methods to measure the fractal dimension (FD) and entropy. Our findings revealed that in surgery patients, the power of chaotic components increased with vascular stiffness. As the intensity of CO fluctuations increased, there was a notable strengthening in the correlation between most complexity measures of PPG and these parameters. Interestingly, some conventional morphological features displayed a significant decrease in correlation, indicating a shift from a static to dynamic scenario. Healthy subjects exhibited a higher percentage of chaotic components, and the correlation between complexity measures and hemodynamics in this group tended to be more pronounced. Causal analysis showed that hemodynamic fluctuations are main influencers for FD changes, with observed feedback in most cases. In conclusion, understanding chaotic patterns in PPG signals is vital for assessing cardiovascular health, especially in individuals with unstable hemodynamics or during ambulatory testing. These insights can help overcome the challenges faced by wearable technologies and enhance their usage in real-world scenarios. Full article

This work focuses on exploring the properties of past Tsallis entropy as it applies to order statistics. The relationship between the past Tsallis entropy of an ordered variable in the context of any continuous probability law and the past Tsallis entropy of the ordered variable resulting from a uniform continuous probability law is worked out. For order statistics, this method offers important insights into the characteristics and behavior of the dynamic Tsallis entropy, which is associated with past events. In addition, we investigate how to find a bound for the new dynamic information measure related to the lifetime unit under various conditions and whether it is monotonic with respect to the time when the device is idle. By exploring these properties and also investigating the monotonic behavior of the new dynamic information measure, we contribute to a broader understanding of order statistics and related entropy quantities. Full article

This study examines the psychometric properties of a screening protocol for dyslexia and demonstrates a special form of matrix factorization called Nous based on the Alternating Least Squares algorithm. Dyslexia presents an intrinsically multidimensional complex of cognitive loads. By building and enforcing a common 6-dimensional space, Nous extracts a multidimensional signal for each person and item from test data that increases the Shannon entropy of the dataset while at the same time being constrained to meet the special objectivity requirements of the Rasch model. The resulting Dyslexia Risk Scale (DRS) yields linear equal-interval measures that are comparable regardless of the subset of items taken by the examinee. Each measure and cell estimate is accompanied by an efficiently calculated standard error. By incorporating examinee age into the calibration process, the DRS can be generalized to all age groups to allow the tracking of individual dyslexia risk over time. The methodology was implemented using a 2019 calibration sample of 828 persons aged 7 to 82 with varying degrees of dyslexia risk. The analysis yielded high reliability (0.95) and excellent receiver operating characteristics (AUC = 0.96). The analysis is accompanied by a discussion of the information-theoretic properties of matrix factorization. Full article