This paper analyzes the semantic rate–distortion problem motivated by task-oriented data compression with side information. The semantic information related to a task is not directly accessible to the encoder but implicitly impacts the observat...
In this work, we establish a full single-letter characterization of the rate-distortion region of an instance of the Gray–Wyner model with side information at the decoders. Specifically, in this model, an encoder observes a pair of memoryless, arbitr...
In the rate-distortion function and the Maximum Entropy (ME) method, Minimum Mutual Information (MMI) distributions and ME distributions are expressed by Bayes-like formulas, including Negative Exponential Functions (NEFs) and partition functions. Wh...
Background: Topological Data Analysis (TDA) captures multi-scale geometric features of data as persistence diagrams, yet no principled information-theoretic framework quantifies how much information those features carry, how efficiently they compress...
This paper describes a novel scheme for the fusion of spectrum sensing information in cooperative spectrum sensing for cognitive radio applications. The scheme combines a spectrum-efficient, pre-distortion-based fusion strategy with an energy-efficie...
13 July 2022
During the COVID-19 pandemic, distorted information about the COVID-19 vaccination is widely disseminated through social media. The present study examined the association between perceived information distortion about COVID-19 vaccination on social m...
In this article, we investigate limitations of importing methods based on algorithmic information theory from monoplex networks into multidimensional networks (such as multilayer networks) that have a large number of extra dimensions (i.e., aspects)....
Management based on reliable, complete, and up-to-date information is key to increasing a transport chain’s effectiveness and sustainability. The instability of the business environment and the increase in competition have contributed to the gr...
Shannon introduced the fields of information theory and rate distortion theory in his landmark 1948 paper [...]
This work introduces a two-stage framework, named the Distorted underwater image Restoration Network (DR-Net), to address the complex degradation of underwater images caused by turbulence, water flow fluctuations, and optical properties of water. The...
Traditional rate–distortion (RD) theory examines the trade-off between the average length of the compressed representation of a source and the additive distortions of its reconstruction. The rate–distortion–perception (RDP) framewor...
We consider the rate distortion problem with side information at the decoder posed and investigated by Wyner and Ziv. Using side information and encoded original data, the decoder must reconstruct the original data with an arbitrary prescribed distor...
10 February 2023
Organizational safety decisions rely heavily on safety information in today’s data-driven era, but there is a significant danger of information distortion that can compromise system safety. To address the issue of information distortion and enh...
Does semantic communication require a semantic information theory parallel to Shannon’s information theory, or can Shannon’s work be generalized for semantic communication? This paper advocates for the latter and introduces a semantic gen...
Steganography is one of the most crucial methods for information hiding, which embeds secret data on an ordinary file or a cover message for avoiding detection. We designed a novel rate-distortion-based large-capacity secure steganographic system, ca...
Let
How to extract relevant information from large data sets has become a main challenge in data visualization. Clustering techniques that classify data into groups according to similarity metrics are a suitable strategy to tackle this problem. Generally...
Motivated by task-oriented semantic communication and distributed learning systems, this paper studies a distributed indirect source coding problem where M correlated sources are independently encoded for a central decoder. The decoder has access to...
Assuming sparsity or compressibility of the underlying signals, compressed sensing or compressive sampling (CS) exploits the informational efficiency of under-sampled measurements for increased efficiency yet acceptable accuracy in information gather...
The linear geometry distortion caused by time variant bistatic angles induces the sheared shape of the bistatic inverse synthetic aperture radar (bistatic-ISAR) image. A linear geometry distortion alleviation algorithm for space targets in bistatic-I...
In this paper, we derive lower and upper bounds on the OPTA of a two-user multi-input multi-output (MIMO) causal encoding and causal decoding problem. Each user’s source model is described by a multidimensional Markov source driven by additive...
The Predictive Rate–Distortion curve quantifies the trade-off between compressing information about the past of a stochastic process and predicting its future accurately. Existing estimation methods for this curve work by clustering finite sequ...
Information Bottleneck-based methods use mutual information as a distortion function in order to extract relevant details about the structure of a complex system by compression. One of the approaches used to generate optimal compressed representation...
In a compact group the Haar probability measure plays the role of uniform distribution. The entropy and rate distortion theory for this uniform distribution is studied. New results and simplified proofs on convergence of convolutions on compact group...
Being a victim of abuse in childhood can lead to the development of trauma-related psychopathology, which could affect the testimony of the child victim. Post-traumatic stress disorder (PTSD) is a factor that can increase both the levels of suggestib...
A central conundrum enshrouds biocognition: almost all such phenomena are inherently unstable and must be constantly controlled by external regulatory machinery to ensure proper function, in much the same sense that blood pressure and the ‘stre...
Man-made communications signals are typically modelled as continuous-time (CT) wide-sense cyclostationary (WSCS) processes. As modern processing is digital, it is applied to discrete-time (DT) processes obtained by sampling the CT processes. When sam...
This study focuses on reducing harmonic distortion in residential electrical systems caused by the use of nonlinear household appliances. A combined prediction and control framework is proposed to estimate and reduce total harmonic distortion (THD) u...
In recent years, hybrid systems combining data-driven and physics-based approaches have gained increasing attention for solving complex real-world problems where deterministic modeling alone is insufficient. Within this framework, Physics-Informed Ne...
Selective harmonic elimination pulse-width modulation places exact spectral nulls at fundamental-frequency switching, yet its defining transcendental system admits no closed form and is resolved offline, leaving the deployed modulator without an opti...
We present a new decentralized classification system based on a distributed architecture. This system consists of distributed nodes, each possessing their own datasets and computing modules, along with a centralized server, which provides probes to c...
In recent years, semantic communication has received significant attention from both academia and industry, driven by the growing demands for ultra-low latency and high-throughput capabilities in emerging intelligent services. Nonetheless, a comprehe...
This tutorial paper focuses on the variants of the bottleneck problem taking an information theoretic perspective and discusses practical methods to solve it, as well as its connection to coding and learning aspects. The intimate connections of this...
(1) Background: As biofortified fish meat is becoming increasingly available, the use of supplements within fish feed may impact consumers’ perceptions and their willingness to pay (WTP) for the product. This study focused on evaluating the sen...
Compressive sampling or compressed sensing (CS) works on the assumption of the sparsity or compressibility of the underlying signal, relies on the trans-informational capability of the measurement matrix employed and the resultant measurements, opera...
Ecohydrological models vary in their sensitivity to forcing data and use available information to different extents. We focus on the impact of forcing precision on ecohydrological model behavior particularly by quantizing, or binning, time-series for...
Time series data are prevalent in diverse fields such as manufacturing and sensor-based human activity recognition. In real-world applications, these data are often collected with variable sample lengths, which can pose challenges for classification...
Semantic communication has recently gained significant attention in theoretical analysis due to its potential to improve communication efficiency by focusing on meaning rather than exact signal reconstruction. In this paper, we extend the Blahut&ndas...
This article reviews results from the literature illustrating the bottlenecks and tradeoffs of integrated sensing and communication (ISAC) through the lens of information theory, thus offering a distinct perspective compared to recent works that focu...
Imaging through wavy air-water surface suffers from uneven geometric distortions and motion blur due to surface fluctuations. Structural information of distorted underwater images is needed to correct this in some cases, such as submarine cable inspe...
Fewer contribution feature components in the image high-dimensional steganalysis feature are able to increase the spatio-temporal complexity of detecting the stego images, and even reduce the detection accuracy. In order to maintain or even improve t...
Against the backdrop of the deepening digital economy and accelerated green and low-carbon transformation, data factors have emerged as a core strategic resource driving the formation and allocation of new quality productive forces. Whether data can...
27 September 2022
Patient compliance with prescribed medication regimens is critical for maintaining health and managing disease and illness. To encourage patient compliance, multiple aids, like automatic pill dispensers, pill organizers, and various reminder applicat...
Biased estimates and fluctuating measures of central tendency are significant impediments to statistical inference and computational data analysis and are often caused by partial and distorted observations. The imputed least-squares-based estimators...
A composite source model consists of an intrinsic state and an extrinsic observation. The fundamental performance limit of reproducing the intrinsic state is characterized by the indirect rate–distortion function. In a remote classification app...
In a broad sense, a True Information Processor is a processor that collects, stores, and controls real information (signal) and is abbreviated as TIP. In a narrow sense, a True Information Processor refers to an information processor used to process...
Seeking goals carried out by agents with a level of competency requires an “understanding” of the structure of their world. While abstract formal descriptions of a world structure in terms of geometric axioms can be formulated in principl...
The existing work has conducted in-depth research and analysis on global differential privacy (GDP) and local differential privacy (LDP) based on information theory. However, the data privacy preserving community does not systematically review and an...
The partial information decomposition (PID) aims to quantify the amount of redundant information that a set of sources provides about a target. Here, we show that this goal can be formulated as a type of information bottleneck (IB) problem, termed th...
Many researchers want to unify probability and logic by defining logical probability or probabilistic logic reasonably. This paper tries to unify statistics and logic so that we can use both statistical probability and logical probability at the same...
of 35