Skip to Content

1,766 Results Found

  • Article
  • Open Access
2 Citations
3,688 Views
17 Pages

Improving Audio Classification Method by Combining Self-Supervision with Knowledge Distillation

  • Xuchao Gong,
  • Hongjie Duan,
  • Yaozhong Yang,
  • Lizhuang Tan,
  • Jian Wang and
  • Athanasios V. Vasilakos

The current audio single-mode self-supervised classification mainly adopts a strategy based on audio spectrum reconstruction. Overall, its self-supervised approach is relatively single and cannot fully mine key semantic information in the time and fr...

  • Article
  • Open Access
11 Citations
3,361 Views
23 Pages

28 June 2022

Although the means of catching remote sensing images are becoming more effective and more abundant, the samples that can be collected in some specific environments can be quite scarce. When there are limited labeled samples, the methods for analyzing...

  • Article
  • Open Access
9 Citations
3,966 Views
19 Pages

Towards Single 2D Image-Level Self-Supervision for 3D Human Pose and Shape Estimation

  • Junuk Cha,
  • Muhammad Saqlain,
  • Changhwa Lee,
  • Seongyeong Lee,
  • Seungeun Lee,
  • Donguk Kim,
  • Won-Hee Park and
  • Seungryul Baek

18 October 2021

Three-dimensional human pose and shape estimation is an important problem in the computer vision community, with numerous applications such as augmented reality, virtual reality, human computer interaction, and so on. However, training accurate 3D hu...

  • Article
  • Open Access
11 Citations
7,361 Views
19 Pages

Pose ResNet: 3D Human Pose Estimation Based on Self-Supervision

  • Wenxia Bao,
  • Zhongyu Ma,
  • Dong Liang,
  • Xianjun Yang and
  • Tao Niu

12 March 2023

The accurate estimation of a 3D human pose is of great importance in many fields, such as human–computer interaction, motion recognition and automatic driving. In view of the difficulty of obtaining 3D ground truth labels for a dataset of 3D po...

  • Article
  • Open Access
13 Citations
5,041 Views
14 Pages

Is self-supervised deep learning (DL) for medical image analysis already a serious alternative to the de facto standard of end-to-end trained supervised DL? We tackle this question for medical image classification, with a particular focus on one of t...

  • Article
  • Open Access
3 Citations
2,002 Views
14 Pages

Improving Air Quality Prediction via Self-Supervision Masked Air Modeling

  • Shuang Chen,
  • Li He,
  • Shinan Shen,
  • Yan Zhang and
  • Weichun Ma

19 July 2024

Presently, the harm to human health created by air pollution has greatly drawn public attention, in particular, vehicle emissions including nitrogen oxides as well as particulate matter. How to predict air quality, e.g., pollutant concentration, effi...

  • Article
  • Open Access
34 Citations
3,984 Views
18 Pages

Self-Supervised Assisted Semi-Supervised Residual Network for Hyperspectral Image Classification

  • Liangliang Song,
  • Zhixi Feng,
  • Shuyuan Yang,
  • Xinyu Zhang and
  • Licheng Jiao

23 June 2022

Due to the scarcity and high cost of labeled hyperspectral image (HSI) samples, many deep learning methods driven by massive data cannot achieve the intended expectations. Semi-supervised and self-supervised algorithms have advantages in coping with...

  • Article
  • Open Access
2 Citations
2,739 Views
18 Pages

Improving an Acoustic Vehicle Detector Using an Iterative Self-Supervision Procedure

  • Birdy Phathanapirom,
  • Jason Hite,
  • Kenneth Dayman,
  • David Chichester and
  • Jared Johnson

25 March 2023

In many non-canonical data science scenarios, obtaining, detecting, attributing, and annotating enough high-quality training data is the primary barrier to developing highly effective models. Moreover, in many problems that are not sufficiently defin...

  • Article
  • Open Access
3 Citations
3,783 Views
24 Pages

Knowledge-Aware Graph Self-Supervised Learning for Recommendation

  • Shanshan Li,
  • Yutong Jia,
  • You Wu,
  • Ning Wei,
  • Liyan Zhang and
  • Jingfeng Guo

2 December 2023

Collaborative filtering (CF) based on graph neural networks (GNN) can capture higher-order relationships between nodes, which in turn improves recommendation performance. Although effective, GNN-based methods still face the challenges of sparsity and...

  • Feature Paper
  • Review
  • Open Access
1,388 Citations
69,552 Views
22 Pages

A Survey on Contrastive Self-Supervised Learning

  • Ashish Jaiswal,
  • Ashwin Ramesh Babu,
  • Mohammad Zaki Zadeh,
  • Debapriya Banerjee and
  • Fillia Makedon

Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudolabels as supervision and use the learned representations for several downstream...

  • Article
  • Open Access
11 Citations
7,110 Views
26 Pages

How Well Do Self-Supervised Models Transfer to Medical Imaging?

  • Jonah Anton,
  • Liam Castelli,
  • Mun Fai Chan,
  • Mathilde Outters,
  • Wan Hee Tang,
  • Venus Cheung,
  • Pancham Shukla,
  • Rahee Walambe and
  • Ketan Kotecha

1 December 2022

Self-supervised learning approaches have seen success transferring between similar medical imaging datasets, however there has been no large scale attempt to compare the transferability of self-supervised models against each other on medical images....

  • Article
  • Open Access
189 Views
29 Pages

27 February 2026

Automated radiology report generation has become a prominent research topic in medical multimodal learning. However, most existing approaches primarily focus on single-image interpretation and rarely address the task of tracking disease progression a...

  • Article
  • Open Access
17 Citations
5,070 Views
13 Pages

Self-Supervised Transfer Learning from Natural Images for Sound Classification

  • Sungho Shin,
  • Jongwon Kim,
  • Yeonguk Yu,
  • Seongju Lee and
  • Kyoobin Lee

29 March 2021

We propose the implementation of transfer learning from natural images to audio-based images using self-supervised learning schemes. Through self-supervised learning, convolutional neural networks (CNNs) can learn the general representation of natura...

  • Article
  • Open Access
1 Citations
3,080 Views
14 Pages

23 December 2022

To alleviate the impact of insufficient labels in less-labeled classification problems, self-supervised learning improves the performance of graph neural networks (GNNs) by focusing on the information of unlabeled nodes. However, none of the existing...

  • Article
  • Open Access
21 Citations
4,426 Views
14 Pages

Self-Supervised Clustering for Leaf Disease Identification

  • Muhammad Mostafa Monowar,
  • Md. Abdul Hamid,
  • Faris A. Kateb,
  • Abu Quwsar Ohi and
  • M. F. Mridha

Plant diseases have been one of the most threatening scenarios to farmers. Although most plant diseases can be identified by observing leaves, it often requires human expertise. The recent improvements in computer vision have led to introduce disease...

  • Article
  • Open Access
6 Citations
2,948 Views
16 Pages

Self-Supervised Depth Completion Based on Multi-Modal Spatio-Temporal Consistency

  • Quan Zhang,
  • Xiaoyu Chen,
  • Xingguo Wang,
  • Jing Han,
  • Yi Zhang and
  • Jiang Yue

26 December 2022

Due to the low cost and easy deployment, self-supervised depth completion has been widely studied in recent years. In this work, a self-supervised depth completion method is designed based on multi-modal spatio-temporal consistency (MSC). The self-su...

  • Article
  • Open Access
8 Citations
2,770 Views
13 Pages

1 February 2023

This paper introduces a novel approach to leveraging features learned from both supervised and self-supervised paradigms, to improve image classification tasks, specifically for vehicle classification. Two state-of-the-art self-supervised learning me...

  • Article
  • Open Access
9 Citations
3,038 Views
20 Pages

1 February 2023

With the increasing visual realism of computer-graphics (CG) images generated by advanced rendering engines, the distinction between CG images and natural images (NIs) has become an important research problem in the image forensics community. Previou...

  • Technical Note
  • Open Access
10 Citations
4,961 Views
14 Pages

Self-Supervised Encoders Are Better Transfer Learners in Remote Sensing Applications

  • Zachary D. Calhoun,
  • Saad Lahrichi,
  • Simiao Ren,
  • Jordan M. Malof and
  • Kyle Bradbury

1 November 2022

Transfer learning has been shown to be an effective method for achieving high-performance models when applying deep learning to remote sensing data. Recent research has demonstrated that representations learned through self-supervision transfer bette...

  • Article
  • Open Access
6 Citations
5,480 Views
24 Pages

Monocular Depth Estimation via Self-Supervised Self-Distillation

  • Haifeng Hu,
  • Yuyang Feng,
  • Dapeng Li,
  • Suofei Zhang and
  • Haitao Zhao

24 June 2024

Self-supervised monocular depth estimation can exhibit excellent performance in static environments due to the multi-view consistency assumption during the training process. However, it is hard to maintain depth consistency in dynamic scenes when con...

  • Article
  • Open Access
1 Citations
1,705 Views
15 Pages

Enhancing image quality provides more interpretability for both human beings and machines. Traditional image enhancement techniques work well for specific uses, but they struggle with images taken in extreme conditions, such as varied distortions, no...

  • Article
  • Open Access
1 Citations
3,510 Views
13 Pages

A Masked Self-Supervised Pretraining Method for Face Parsing

  • Zhuang Li,
  • Leilei Cao,
  • Hongbin Wang and
  • Lihong Xu

10 June 2022

Face Parsing aims to partition the face into different semantic parts, which can be applied into many downstream tasks, e.g., face mask up, face swapping, and face animation. With the popularity of cameras, it is easier to acquire facial images. Howe...

  • Article
  • Open Access
2 Citations
2,344 Views
18 Pages

Seismic Blind Deconvolution Based on Self-Supervised Machine Learning

  • Xia Yin,
  • Wenhao Xu,
  • Zhifang Yang and
  • Bangyu Wu

15 June 2024

Seismic deconvolution is a useful tool in seismic data processing. Classical non-machine learning deconvolution methods usually apply quite a few constraints to both wavelet inversion and reflectivity inversion. Supervised machine learning deconvolut...

  • Article
  • Open Access
4 Citations
2,655 Views
14 Pages

Self-Supervised Clustering Models Based on BYOL Network Structure

  • Xuehao Chen,
  • Jin Zhou,
  • Yuehui Chen,
  • Shiyuan Han,
  • Yingxu Wang,
  • Tao Du,
  • Cheng Yang and
  • Bowen Liu

21 November 2023

Contrastive-based clustering models usually rely on a large number of negative pairs to capture uniform representations, which requires a large batch size and high computational complexity. In contrast, some self-supervised methods perform non-contra...

  • Article
  • Open Access
7 Citations
2,394 Views
13 Pages

Self-Supervised Learning for Solar Radio Spectrum Classification

  • Siqi Li,
  • Guowu Yuan,
  • Jian Chen,
  • Chengming Tan and
  • Hao Zhou

14 December 2022

Solar radio observation is an important way to study the Sun. Solar radio bursts contain important information about solar activity. Therefore, real-time automatic detection and classification of solar radio bursts are of great value for subsequent s...

  • Article
  • Open Access
2 Citations
1,808 Views
32 Pages

28 June 2025

Human activity recognition (HAR) using wearable sensors has advanced through various machine learning paradigms, each with inherent trade-offs between performance and labeling requirements. While fully supervised techniques achieve high accuracy, the...

  • Article
  • Open Access
6 Citations
3,953 Views
15 Pages

Self-Supervised Human Activity Representation for Embodied Cognition Assessment

  • Mohammad Zaki Zadeh,
  • Ashwin Ramesh Babu,
  • Ashish Jaiswal and
  • Fillia Makedon

Physical activities, according to the embodied cognition theory, are an important manifestation of cognitive functions. As a result, in this paper, the Activate Test of Embodied Cognition (ATEC) system is proposed to assess various cognitive measures...

  • Article
  • Open Access
3 Citations
2,732 Views
17 Pages

Popularity-Debiased Graph Self-Supervised for Recommendation

  • Shanshan Li,
  • Xinzhuan Hu,
  • Jingfeng Guo,
  • Bin Liu,
  • Mingyue Qi and
  • Yutong Jia

The rise of graph neural networks has greatly contributed to the development of recommendation systems, and self-supervised learning has emerged as one of the most important approaches to address sparse interaction data. However, existing methods mos...

  • Article
  • Open Access
11 Citations
3,623 Views
17 Pages

Joint Soft–Hard Attention for Self-Supervised Monocular Depth Estimation

  • Chao Fan,
  • Zhenyu Yin,
  • Fulong Xu,
  • Anying Chai and
  • Feiqing Zhang

20 October 2021

In recent years, self-supervised monocular depth estimation has gained popularity among researchers because it uses only a single camera at a much lower cost than the direct use of laser sensors to acquire depth. Although monocular self-supervised me...

  • Article
  • Open Access
3 Citations
3,676 Views
23 Pages

Self-supervised learning continues to drive advancements in machine learning. However, the absence of unified computational processes for benchmarking and evaluation remains a challenge. This study conducts a comprehensive analysis of state-of-the-ar...

  • Article
  • Open Access
4 Citations
2,599 Views
19 Pages

29 May 2024

We present a new method of self-supervised learning and knowledge distillation based on multi-views and multi-representations (MV–MR). MV–MR is based on the maximization of dependence between learnable embeddings from augmented and non-au...

  • Article
  • Open Access
1 Citations
2,738 Views
20 Pages

Text Geolocation Prediction via Self-Supervised Learning

  • Yuxing Wu,
  • Zhuang Zeng,
  • Kaiyue Liu,
  • Zhouzheng Xu,
  • Yaqin Ye,
  • Shunping Zhou,
  • Huangbao Yao and
  • Shengwen Li

Text geolocation prediction aims to infer the geographic location of text with text semantics, serving as a fundamental task for various geographic applications. As the mainstream approach, the deep learning-based methods follow the supervised learni...

  • Article
  • Open Access
5 Citations
2,448 Views
18 Pages

24 April 2024

Accurate traffic prediction is pivotal when constructing intelligent cities to enhance urban mobility and to efficiently manage traffic flows. Traditional deep learning-based traffic prediction models primarily focus on capturing spatial and temporal...

  • Article
  • Open Access
3 Citations
1,859 Views
14 Pages

SPDepth: Enhancing Self-Supervised Indoor Monocular Depth Estimation via Self-Propagation

  • Xiaotong Guo,
  • Huijie Zhao,
  • Shuwei Shao,
  • Xudong Li,
  • Baochang Zhang and
  • Na Li

16 October 2024

Due to the existence of low-textured areas in indoor scenes, some self-supervised depth estimation methods have specifically designed sparse photometric consistency losses and geometry-based losses. However, some of the loss terms cannot supervise al...

  • Technical Note
  • Open Access
2 Citations
4,549 Views
17 Pages

Self-Supervised Monocular Depth Learning in Low-Texture Areas

  • Wanpeng Xu,
  • Ling Zou,
  • Lingda Wu and
  • Zhipeng Fu

26 April 2021

For the task of monocular depth estimation, self-supervised learning supervises training by calculating the pixel difference between the target image and the warped reference image, obtaining results comparable to those with full supervision. However...

  • Article
  • Open Access
18 Citations
6,354 Views
19 Pages

26 December 2022

The success of image classification depends on copious annotated images for training. Annotating histopathology images is costly and laborious. Although several successful self-supervised representation learning approaches have been introduced, they...

  • Article
  • Open Access
1 Citations
452 Views
13 Pages

25 November 2025

Background/Objectives: Magnetic resonance imaging (MRI) is a widely used non-invasive imaging modality that provides high-fidelity soft-tissue contrast without ionizing radiation. However, acquiring high-resolution MRI scans is time-consuming, necess...

  • Article
  • Open Access
14 Citations
3,915 Views
17 Pages

Self-Supervised Wavelet-Based Attention Network for Semantic Segmentation of MRI Brain Tumor

  • Govindarajan Anusooya,
  • Selvaraj Bharathiraja,
  • Miroslav Mahdal,
  • Kamsundher Sathyarajasekaran and
  • Muniyandy Elangovan

2 March 2023

To determine the appropriate treatment plan for patients, radiologists must reliably detect brain tumors. Despite the fact that manual segmentation involves a great deal of knowledge and ability, it may sometimes be inaccurate. By evaluating the size...

  • Article
  • Open Access
374 Views
17 Pages

Self-Supervised Ship Identification in Optical Satellite Imagery

  • Kian Bostani Nezhad,
  • Peder Heiselberg,
  • Hasse Bülow Pedersen and
  • Henning Heiselberg

AIS, the global ship identification standard, is vulnerable to outages, coverage gaps, and deliberate deactivation, highlighting the need for independent ship identification methods. Optical imaging satellites offer a global, non-compliance-dependent...

  • Article
  • Open Access
4 Citations
5,873 Views
13 Pages

17 January 2024

Emotion recognition models using audio input data can enable the development of interactive systems with applications in mental healthcare, marketing, gaming, and social media analysis. While the field of affective computing using audio data is rich,...

  • Article
  • Open Access
7 Citations
4,198 Views
22 Pages

Heuristic Attention Representation Learning for Self-Supervised Pretraining

  • Van Nhiem Tran,
  • Shen-Hsuan Liu,
  • Yung-Hui Li and
  • Jia-Ching Wang

10 July 2022

Recently, self-supervised learning methods have been shown to be very powerful and efficient for yielding robust representation learning by maximizing the similarity across different augmented views in embedding vector space. However, the main challe...

  • Article
  • Open Access
3 Citations
3,927 Views
13 Pages

Self-Supervised Joint Learning for pCLE Image Denoising

  • Kun Yang,
  • Haojie Zhang,
  • Yufei Qiu,
  • Tong Zhai and
  • Zhiguo Zhang

30 April 2024

Probe-based confocal laser endoscopy (pCLE) has emerged as a powerful tool for disease diagnosis, yet it faces challenges such as the formation of hexagonal patterns in images due to the inherent characteristics of fiber bundles. Recent advancements...

  • Article
  • Open Access
5 Citations
2,828 Views
14 Pages

Self-Supervised Spatio-Temporal Graph Learning for Point-of-Interest Recommendation

  • Jiawei Liu,
  • Haihan Gao,
  • Chuan Shi,
  • Hongtao Cheng and
  • Qianlong Xie

1 August 2023

As one of the most crucial topics in the recommendation system field, point-of-interest (POI) recommendation aims to recommending potential interesting POIs to users. Recently, graph neural networks have been successfully used to model interaction an...

  • Article
  • Open Access
32 Citations
11,707 Views
17 Pages

22 October 2021

Automatic ship detection provides an essential function towards maritime domain awareness for security or economic monitoring purposes. This work presents an approach for training a deep learning ship detector in Sentinel-2 multi-spectral images with...

  • Review
  • Open Access
64 Citations
10,892 Views
37 Pages

17 August 2022

Deep learning methods have become an integral part of computer vision and machine learning research by providing significant improvement performed in many tasks such as classification, regression, and detection. These gains have been also observed in...

  • Article
  • Open Access
6 Citations
3,963 Views
17 Pages

Due to the complementary nature of graph neural networks and structured data in recommendations, recommendation systems using graph neural network techniques have become mainstream. However, there are still problems, such as sparse supervised signals...

  • Article
  • Open Access
787 Views
29 Pages

Speckle2Self: Learning Self-Supervised Despeckling with Attention Mechanism for SAR Images

  • Huiping Lin,
  • Xin Su,
  • Zhiqiang Zeng,
  • Cheng Xing and
  • Junjun Yin

27 November 2025

Despite the in-depth understanding of the synthetic aperture-radar (SAR) speckle and its characteristics, despeckling remains an open issue far from being solved. Deep-learning methods with supervised training have made great progress. However, relia...

  • Article
  • Open Access
8 Citations
2,335 Views
15 Pages

Spectrum Sensing Algorithm Based on Self-Supervised Contrast Learning

  • Xinyu Li,
  • Zhijin Zhao,
  • Yupei Zhang,
  • Shilian Zheng and
  • Shaogang Dai

The traditional spectrum sensing algorithm based on deep learning requires a large number of labeled samples for model training, but it is difficult to obtain them in the actual sensing scene. This paper applies self-supervised contrast learning in o...

  • Article
  • Open Access
29 Citations
4,461 Views
15 Pages

Self-Supervised Learning to Increase the Performance of Skin Lesion Classification

  • Arkadiusz Kwasigroch,
  • Michał Grochowski and
  • Agnieszka Mikołajczyk

17 November 2020

To successfully train a deep neural network, a large amount of human-labeled data is required. Unfortunately, in many areas, collecting and labeling data is a difficult and tedious task. Several ways have been developed to mitigate the problem associ...

  • Article
  • Open Access
432 Views
23 Pages

16 December 2025

Deep learning (DL), a hierarchical feature extraction method, has garnered increasing attention in the remote sensing community. Recently, self-supervised learning (SSL) methods in DL have gained wide recognition due to their ability to mitigate the...

of 36