Sign in to use this feature.

Years

Between: -

Subjects

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Journals

Article Types

Countries / Regions

Search Results (5)

Search Parameters:
Keywords = variational mutual information maximization

Order results
Result details
Results per page
Select all
Export citation of selected articles as:
24 pages, 3113 KB  
Article
Gradual Geometry-Guided Knowledge Distillation for Source-Data-Free Domain Adaptation
by Yangkuiyi Zhang and Song Tang
Mathematics 2025, 13(9), 1491; https://doi.org/10.3390/math13091491 - 30 Apr 2025
Viewed by 502
Abstract
Due to access to the source data during the transfer phase, conventional domain adaptation works have recently raised safety and privacy concerns. More research attention thus shifts to a more practical setting known as source-data-free domain adaptation (SFDA). The new challenge is how [...] Read more.
Due to access to the source data during the transfer phase, conventional domain adaptation works have recently raised safety and privacy concerns. More research attention thus shifts to a more practical setting known as source-data-free domain adaptation (SFDA). The new challenge is how to obtain reliable semantic supervision in the absence of source domain training data and the labels on the target domain. To that end, in this work, we introduce a novel Gradual Geometry-Guided Knowledge Distillation (G2KD) approach for SFDA. Specifically, to address the lack of supervision, we used local geometry of data to construct a more credible probability distribution over the potential categories, termed geometry-guided knowledge. Then, knowledge distillation was adopted to integrate this extra information for boosting the adaptation. More specifically, first, we constructed a neighborhood geometry for any target data using a similarity comparison on the whole target dataset. Second, based on pre-obtained semantic estimation by clustering, we mined soft semantic representations expressing the geometry-guided knowledge by semantic fusion. Third, using the soften labels, we performed knowledge distillation regulated by the new objective. Considering the unsupervised setting of SFDA, in addition to the distillation loss and student loss, we introduced a mixed entropy regulator that minimized the entropy of individual data as well as maximized the mutual entropy with augmentation data to utilize neighbor relation. Our contribution is that, through local geometry discovery with semantic representation and self-knowledge distillation, the semantic information hidden in the local structures is transformed to effective semantic self-supervision. Also, our knowledge distillation works in a gradual way that is helpful to capture the dynamic variations in the local geometry, mitigating the previous guidance degradation and deviation at the same time. Extensive experiments on five challenging benchmarks confirmed the state-of-the-art performance of our method. Full article
(This article belongs to the Special Issue Robust Perception and Control in Prognostic Systems)
Show Figures

Figure 1

27 pages, 1367 KB  
Article
InfoSTGCAN: An Information-Maximizing Spatial-Temporal Graph Convolutional Attention Network for Heterogeneous Human Trajectory Prediction
by Kangrui Ruan and Xuan Di
Computers 2024, 13(6), 151; https://doi.org/10.3390/computers13060151 - 11 Jun 2024
Cited by 7 | Viewed by 1990
Abstract
Predicting the future trajectories of multiple interacting pedestrians within a scene has increasingly gained importance in various fields, e.g., autonomous driving, human–robot interaction, and so on. The complexity of this problem is heightened due to the social dynamics among different pedestrians and their [...] Read more.
Predicting the future trajectories of multiple interacting pedestrians within a scene has increasingly gained importance in various fields, e.g., autonomous driving, human–robot interaction, and so on. The complexity of this problem is heightened due to the social dynamics among different pedestrians and their heterogeneous implicit preferences. In this paper, we present Information Maximizing Spatial-Temporal Graph Convolutional Attention Network (InfoSTGCAN), which takes into account both pedestrian interactions and heterogeneous behavior choice modeling. To effectively capture the complex interactions among pedestrians, we integrate spatial-temporal graph convolution and spatial-temporal graph attention. For grasping the heterogeneity in pedestrians’ behavior choices, our model goes a step further by learning to predict an individual-level latent code for each pedestrian. Each latent code represents a distinct pattern of movement choice. Finally, based on the observed historical trajectory and the learned latent code, the proposed method is trained to cover the ground-truth future trajectory of this pedestrian with a bi-variate Gaussian distribution. We evaluate the proposed method through a comprehensive list of experiments and demonstrate that our method outperforms all baseline methods on the commonly used metrics, Average Displacement Error and Final Displacement Error. Notably, visualizations of the generated trajectories reveal our method’s capacity to handle different scenarios. Full article
Show Figures

Figure 1

18 pages, 9250 KB  
Article
Multispectral Band-Aware Generation of Satellite Images across Domains Using Generative Adversarial Networks and Contrastive Learning
by Arpan Mahara and Naphtali Rishe
Remote Sens. 2024, 16(7), 1154; https://doi.org/10.3390/rs16071154 - 26 Mar 2024
Cited by 3 | Viewed by 2022
Abstract
Generative models have recently gained popularity in remote sensing, offering substantial benefits for interpreting and utilizing satellite imagery across diverse applications such as climate monitoring, urban planning, and wildfire detection. These models are particularly adept at addressing the challenges posed by satellite images, [...] Read more.
Generative models have recently gained popularity in remote sensing, offering substantial benefits for interpreting and utilizing satellite imagery across diverse applications such as climate monitoring, urban planning, and wildfire detection. These models are particularly adept at addressing the challenges posed by satellite images, which often exhibit domain variability due to seasonal changes, sensor characteristics, and, especially, variations in spectral bands. Such variability can significantly impact model performance across various tasks. In response to these challenges, our work introduces an adaptive approach that harnesses the capabilities of generative adversarial networks (GANs), augmented with contrastive learning, to generate target domain images that account for multispectral band variations effectively. By maximizing mutual information between corresponding patches and leveraging the power of GANs, our model aims to generate realistic-looking images across different multispectral domains. We present a comparative analysis of our model against other well-established generative models, demonstrating its efficacy in generating high-quality satellite images while effectively managing domain variations inherent to multispectral diversity. Full article
(This article belongs to the Section AI Remote Sensing)
Show Figures

Graphical abstract

20 pages, 6719 KB  
Article
Intelligent Diagnosis of Rolling Element Bearing Based on Refined Composite Multiscale Reverse Dispersion Entropy and Random Forest
by Aiqiang Liu, Zuye Yang, Hongkun Li, Chaoge Wang and Xuejun Liu
Sensors 2022, 22(5), 2046; https://doi.org/10.3390/s22052046 - 6 Mar 2022
Cited by 16 | Viewed by 3238
Abstract
Rolling bearings are the vital components of large electromechanical equipment, thus it is of great significance to develop intelligent fault diagnoses for them to improve equipment operation reliability. In this paper, a fault diagnosis method based on refined composite multiscale reverse dispersion entropy [...] Read more.
Rolling bearings are the vital components of large electromechanical equipment, thus it is of great significance to develop intelligent fault diagnoses for them to improve equipment operation reliability. In this paper, a fault diagnosis method based on refined composite multiscale reverse dispersion entropy (RCMRDE) and random forest is developed. Firstly, rolling bearing vibration signals are adaptively decomposed by variational mode decomposition (VMD), and then the RCMRDE values of 25 scales are calculated for original signal and each decomposed component as the initial feature set. Secondly, based on the joint mutual information maximization (JMIM) algorithm, the top 15 sensitive features are selected as a new feature set and feed into random forest model to identify bearing health status. Finally, to verify the effectiveness and superiority of the presented method, actual data acquisition and analysis are performed on the bearing fault diagnosis experimental platform. These results indicate that the presented method can precisely diagnose bearing fault types and damage degree, and the average identification accuracy rate is 97.33%. Compared with the refine composite multiscale dispersion entropy (RCMDE) and multiscale dispersion entropy (MDE), the fault diagnosis accuracy is improved by 2.67% and 8.67%, respectively. Furthermore, compared with the RCMRDE method without VMD decomposition, the fault diagnosis accuracy is improved by 3.67%. Research results prove that a better feature extraction technique is proposed, which can effectively overcome the deficiency of existing entropy and significantly enhance the ability of fault identification. Full article
Show Figures

Figure 1

32 pages, 1347 KB  
Review
Non-Random Genome Editing and Natural Cellular Engineering in Cognition-Based Evolution
by William B. Miller, Francisco J. Enguita and Ana Lúcia Leitão
Cells 2021, 10(5), 1125; https://doi.org/10.3390/cells10051125 - 7 May 2021
Cited by 14 | Viewed by 5230
Abstract
Neo-Darwinism presumes that biological variation is a product of random genetic replication errors and natural selection. Cognition-Based Evolution (CBE) asserts a comprehensive alternative approach to phenotypic variation and the generation of biological novelty. In CBE, evolutionary variation is the product of natural cellular [...] Read more.
Neo-Darwinism presumes that biological variation is a product of random genetic replication errors and natural selection. Cognition-Based Evolution (CBE) asserts a comprehensive alternative approach to phenotypic variation and the generation of biological novelty. In CBE, evolutionary variation is the product of natural cellular engineering that permits purposive genetic adjustments as cellular problem-solving. CBE upholds that the cornerstone of biology is the intelligent measuring cell. Since all biological information that is available to cells is ambiguous, multicellularity arises from the cellular requirement to maximize the validity of available environmental information. This is best accomplished through collective measurement purposed towards maintaining and optimizing individual cellular states of homeorhesis as dynamic flux that sustains cellular equipoise. The collective action of the multicellular measurement and assessment of information and its collaborative communication is natural cellular engineering. Its yield is linked cellular ecologies and mutualized niche constructions that comprise biofilms and holobionts. In this context, biological variation is the product of collective differential assessment of ambiguous environmental cues by networking intelligent cells. Such concerted action is enabled by non-random natural genomic editing in response to epigenetic impacts and environmental stresses. Random genetic activity can be either constrained or deployed as a ‘harnessing of stochasticity’. Therefore, genes are cellular tools. Selection filters cellular solutions to environmental stresses to assure continuous cellular-organismal-environmental complementarity. Since all multicellular eukaryotes are holobionts as vast assemblages of participants of each of the three cellular domains (Prokaryota, Archaea, Eukaryota) and the virome, multicellular variation is necessarily a product of co-engineering among them. Full article
Show Figures

Graphical abstract

Back to TopTop