Skip to Content
InformationInformation
  • Article
  • Open Access

24 February 2023

10 Pages

Multi-Dimensional Information Alignment in Different Modalities for Generalized Zero-Shot and Few-Shot Learning

,
,
,
and
1
School of Cyber Science and Engineering, Wuhan University, Wuhan 430072, China
2
School of Computer Science, University of Windsor, Windsor, ON N9B 3P4, Canada
3
School of Information Technology, Deakin University, Geelong 3217, Australia
4
Institute for Interdisciplinary Research, Jianghan University, Wuhan 430056, China
This article belongs to the Special Issue Feature Papers in Information in 2023

Abstract

Generalized zero-shot learning (GZSL) aims to solve the category recognition tasks for unseen categories under the setting that training samples only contain seen classes while unseen classes are not available. This research is vital as there are always existing new categories and large amounts of unlabeled data in realistic scenarios. Previous work for GZSL usually maps the visual information of the visible classes and the semantic description of the invisible classes into the identical embedding space to bridge the gap between the disjointed visible and invisible classes, while ignoring the intrinsic features of visual images, which are sufficiently discriminative to classify themselves. To better use discriminative information from visual classes for GZSL, we propose the n-CADA-VAE. In our approach, we map the visual feature of seen classes to a high-dimensional distribution while mapping the semantic description of unseen classes to a low-dimensional distribution under the same latent embedding space, thus projecting information of different modalities to corresponding space positions more accurately. We conducted extensive experiments on four benchmark datasets (CUB, SUN, AWA1, and AWA2). The results show our model’s superior performance in generalized zero-shot as well as few-shot learning.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.