Skip to Content
You are currently on the new version of our website. Access the old version .

4,145 Results Found

  • Feature Paper
  • Review
  • Open Access
135 Citations
21,396 Views
27 Pages

A Comprehensive Survey of Transformers for Computer Vision

  • Sonain Jamil,
  • Md. Jalil Piran and
  • Oh-Jin Kwon

25 April 2023

As a special type of transformer, vision transformers (ViTs) can be used for various computer vision (CV) applications. Convolutional neural networks (CNNs) have several potential problems that can be resolved with ViTs. For image coding tasks such a...

(This article belongs to the Special Issue Intelligent Image Processing and Sensing for Drones)
  • Review
  • Open Access
51 Citations
8,743 Views
39 Pages

Ultrasound Image Analysis with Vision Transformers—Review

  • Majid Vafaeezadeh,
  • Hamid Behnam and
  • Parisa Gifani

Ultrasound (US) has become a widely used imaging modality in clinical practice, characterized by its rapidly evolving technology, advantages, and unique challenges, such as a low imaging quality and high variability. There is a need to develop advanc...

(This article belongs to the Section Machine Learning and Artificial Intelligence in Diagnostics)
  • Article
  • Open Access
124 Citations
15,929 Views
16 Pages

ViTFER: Facial Emotion Recognition with Vision Transformers

  • Aayushi Chaudhari,
  • Chintan Bhatt,
  • Achyut Krishna and
  • Pier Luigi Mazzeo

In several fields nowadays, automated emotion recognition has been shown to be a highly powerful tool. Mapping different facial expressions to their respective emotional states is the main objective of facial emotion recognition (FER). In this study,...

(This article belongs to the Topic Data Analytics and Machine Learning in Artificial Emotional Intelligence)
  • Review
  • Open Access
4 Citations
2,684 Views
34 Pages

18 February 2026

Vision Transformers (ViTs) have achieved strong performance in computer vision but suffer from limited inductive bias, high data requirements, and reduced sensitivity to high-frequency visual details. To address these limitations, Frequency-Domain Vi...

(This article belongs to the Special Issue The Age of Transformers: Emerging Trends and Applications)
  • Article
  • Open Access
14 Citations
6,664 Views
12 Pages

Artwork Style Recognition Using Vision Transformers and MLP Mixer

  • Lazaros Alexios Iliadis,
  • Spyridon Nikolaidis,
  • Panagiotis Sarigiannidis,
  • Shaohua Wan and
  • Sotirios K. Goudos

Through the extensive study of transformers, attention mechanisms have emerged as potentially more powerful than sequential recurrent processing and convolution. In this realm, Vision Transformers have gained much research interest, since their archi...

(This article belongs to the Special Issue MOCAST 2021)
  • Article
  • Open Access
154 Citations
25,251 Views
32 Pages

Vision Transformers in Image Restoration: A Survey

  • Anas M. Ali,
  • Bilel Benjdira,
  • Anis Koubaa,
  • Walid El-Shafai and ,
  • Zahid Khan and
  • Wadii Boulila
  • + 1 author+ 0 author

21 February 2023

The Vision Transformer (ViT) architecture has been remarkably successful in image restoration. For a while, Convolutional Neural Networks (CNN) predominated in most computer vision tasks. Now, both CNN and ViT are efficient approaches that demonstrat...

(This article belongs to the Section Sensing and Imaging)
  • Article
  • Open Access
35 Citations
3,997 Views
20 Pages

8 April 2024

Endoscopic pathological findings of the gastrointestinal tract are crucial for the early diagnosis of colorectal cancer (CRC). Previous deep learning works, aimed at improving CRC detection performance and reducing subjective analysis errors, are lim...

(This article belongs to the Section Cancer Causes, Screening and Diagnosis)
  • Article
  • Open Access
93 Citations
14,132 Views
24 Pages

Wildfire Segmentation Using Deep Vision Transformers

  • Rafik Ghali,
  • Moulay A. Akhloufi,
  • Marwa Jmal,
  • Wided Souidene Mseddi and
  • Rabah Attia

5 September 2021

In this paper, we address the problem of forest fires’ early detection and segmentation in order to predict their spread and help with fire fighting. Techniques based on Convolutional Networks are the most used and have proven to be efficient at solv...

(This article belongs to the Special Issue Data Mining in Multi-Platform Remote Sensing)
  • Article
  • Open Access
8 Citations
4,062 Views
25 Pages

Optimizing Mobile Vision Transformers for Land Cover Classification

  • Papia F. Rozario,
  • Ravi Gadgil,
  • Junsu Lee,
  • Rahul Gomes and ,
  • Paige Keller,
  • Yiheng Liu,
  • Gabriel Sipos,
  • Grace McDonnell,
  • Westin Impola and
  • Joseph Rudolph
  • + 5 authors+ 0 author

6 July 2024

Image classification in remote sensing and geographic information system (GIS) data containing various land cover classes is essential for efficient and sustainable land use estimation and other tasks like object detection, localization, and segmenta...

(This article belongs to the Section Earth Sciences)
  • Article
  • Open Access
669 Citations
40,902 Views
19 Pages

Vision Transformers for Remote Sensing Image Classification

  • Yakoub Bazi,
  • Laila Bashmal,
  • Mohamad M. Al Rahhal,
  • Reham Al Dayil and
  • Naif Al Ajlan

1 February 2021

In this paper, we propose a remote-sensing scene-classification method based on vision transformers. These types of networks, which are now recognized as state-of-the-art models in natural language processing, do not rely on convolution layers as in...

  • Article
  • Open Access
11 Citations
5,055 Views
13 Pages

Hybrid Quantum Vision Transformers for Event Classification in High Energy Physics

  • Eyup B. Unlu,
  • Marçal Comajoan Cara,
  • Gopal Ramesh Dahale,
  • Zhongtian Dong and ,
  • Roy T. Forestano,
  • Sergei Gleyzer,
  • Daniel Justice,
  • Kyoungchul Kong,
  • Tom Magorsch and
  • Katia Matcheva
  • + 6 authors+ 1 author

13 March 2024

Models based on vision transformer architectures are considered state-of-the-art when it comes to image classification tasks. However, they require extensive computational resources both for training and deployment. The problem is exacerbated as the...

(This article belongs to the Section Mathematical Analysis)
  • Article
  • Open Access
11 Citations
4,083 Views
16 Pages

28 February 2023

Many biometrics advancements have been widely used for security applications. This field’s evolution began with fingerprints and continued with periocular imaging, which has gained popularity due to the pandemic scenario. CNN (convolutional neu...

(This article belongs to the Special Issue Application of Biometrics Technology in Security)
  • Article
  • Open Access
12 Citations
5,781 Views
14 Pages

Quantum Vision Transformers for Quark–Gluon Classification

  • Marçal Comajoan Cara,
  • Gopal Ramesh Dahale,
  • Zhongtian Dong,
  • Roy T. Forestano and ,
  • Sergei Gleyzer,
  • Daniel Justice,
  • Kyoungchul Kong,
  • Tom Magorsch,
  • Konstantin T. Matchev and
  • Eyup B. Unlu
  • + 6 authors+ 1 author

13 May 2024

We introduce a hybrid quantum-classical vision transformer architecture, notable for its integration of variational quantum circuits within both the attention mechanism and the multi-layer perceptrons. The research addresses the critical challenge of...

(This article belongs to the Section Mathematical Analysis)
  • Article
  • Open Access
4 Citations
3,034 Views
23 Pages

Ensemble of Efficient Vision Transformers for Insect Classification

  • Marius Alexandru Dinca,
  • Dan Popescu,
  • Loretta Ichim and
  • Nicoleta Angelescu

7 July 2025

Real-time identification of insect pests is an important research direction in modern agricultural management, directly influencing crop health and yield. Recent advances in computer vision and deep learning, especially vision transformer (ViT) archi...

(This article belongs to the Special Issue Recent Advances and New Trends in Computer Vision and Image Processing)
  • Article
  • Open Access
5 Citations
5,982 Views
14 Pages

Transformer-based models are driving a significant revolution in the field of machine learning at the moment. Among these innovations, vision transformers (ViTs) stand out for their application of transformer architectures to vision-related tasks. By...

(This article belongs to the Section Computer Science & Engineering)
  • Article
  • Open Access
10 Citations
3,995 Views
18 Pages

28 February 2025

This paper addresses the classification of images depicting the eruptive activity of Mount Etna that were captured by a network of ground-based thermal cameras. This study aimed to evaluate the performance of Vision Transformers (ViTs), such as the S...

(This article belongs to the Special Issue Machine Learning Approaches for Geophysical Data Analysis)
  • Article
  • Open Access
15 Citations
6,848 Views
13 Pages

23 August 2022

Vision transformers (ViTs) demonstrate exceptional performance in numerous computer vision tasks owing to their self-attention modules. Despite improved network performance, transformers frequently require significant computational resources. The inc...

(This article belongs to the Special Issue The Future of Artificial Intelligence (AI): Emerging Topics for AI and Its Applications)
  • Article
  • Open Access
17 Citations
5,068 Views
15 Pages

Comparative Analysis of Deep Learning Architectures and Vision Transformers for Musical Key Estimation

  • Manav Garg,
  • Pranshav Gajjar,
  • Pooja Shah,
  • Madhu Shukla and ,
  • Biswaranjan Acharya,
  • Vassilis C. Gerogiannis and
  • Andreas Kanavos
  • + 2 authors+ 0 author

28 September 2023

The musical key serves as a crucial element in a piece, offering vital insights into the tonal center, harmonic structure, and chord progressions while enabling tasks such as transposition and arrangement. Moreover, accurate key estimation finds prac...

(This article belongs to the Topic Advances in Artificial Neural Networks)
  • Article
  • Open Access
19 Citations
5,483 Views
23 Pages

1 March 2023

The manner of walking (gait) is a powerful biometric that is used as a unique fingerprinting method, allowing unobtrusive behavioral analytics to be performed at a distance without subject cooperation. As opposed to more traditional biometric authent...

(This article belongs to the Special Issue Sensors for Biometric Recognition and Authentication)
  • Article
  • Open Access
56 Citations
9,582 Views
14 Pages

A common consequence of diabetes mellitus called diabetic retinopathy (DR) results in lesions on the retina that impair vision. It can cause blindness if not detected in time. Unfortunately, DR cannot be reversed, and treatment simply keeps eyesight...

(This article belongs to the Special Issue Advances in Quantitative Imaging Analysis: From Theory to Practice)
  • Article
  • Open Access
7 Citations
2,799 Views
20 Pages

Through-Ice Acoustic Source Tracking Using Vision Transformers with Ordinal Classification

  • Steven Whitaker,
  • Andrew Barnard,
  • George D. Anderson and
  • Timothy C. Havens

22 June 2022

Ice environments pose challenges for conventional underwater acoustic localization techniques due to their multipath and non-linear nature. In this paper, we compare different deep learning networks, such as Transformers, Convolutional Neural Network...

(This article belongs to the Special Issue Underwater Acoustic Sensors and Applications)
  • Article
  • Open Access
11 Citations
6,438 Views
15 Pages

8 February 2024

In this paper, we propose a new type of vision transformer (ViT) based on graph head attention (GHA). Because the multi-head attention (MHA) of a pure ViT requires multiple parameters and tends to lose the locality of an image, we replaced MHA with G...

(This article belongs to the Special Issue Computer Vision and Machine Learning for Intelligent Sensing Systems—2nd Edition)
  • Article
  • Open Access
8 Citations
3,397 Views
26 Pages

SDViT: Stacking of Distilled Vision Transformers for Hand Gesture Recognition

  • Chun Keat Tan,
  • Kian Ming Lim,
  • Chin Poo Lee,
  • Roy Kwang Yang Chang and
  • Ali Alqahtani

10 November 2023

Hand gesture recognition (HGR) is a rapidly evolving field with the potential to revolutionize human–computer interactions by enabling machines to interpret and understand human gestures for intuitive communication and control. However, HGR fac...

  • Article
  • Open Access
18 Citations
5,578 Views
23 Pages

Classification of Adventitious Sounds Combining Cochleogram and Vision Transformers

  • Loredana Daria Mang,
  • Francisco David González Martínez,
  • Damian Martinez Muñoz,
  • Sebastián García Galán and
  • Raquel Cortina

21 January 2024

Early identification of respiratory irregularities is critical for improving lung health and reducing global mortality rates. The analysis of respiratory sounds plays a significant role in characterizing the respiratory system’s condition and i...

(This article belongs to the Special Issue Advanced Machine Intelligence for Biomedical Signal Processing)
  • Review
  • Open Access
109 Citations
12,933 Views
21 Pages

Convolutional Neural Networks or Vision Transformers: Who Will Win the Race for Action Recognitions in Visual Data?

  • Oumaima Moutik,
  • Hiba Sekkat,
  • Smail Tigani,
  • Abdellah Chehri and ,
  • Rachid Saadane,
  • Taha Ait Tchakoucht and
  • Anand Paul
  • + 2 authors+ 0 author

9 January 2023

Understanding actions in videos remains a significant challenge in computer vision, which has been the subject of several pieces of research in the last decades. Convolutional neural networks (CNN) are a significant component of this topic and play a...

(This article belongs to the Special Issue Sensing Technologies for Image/Video Analysis)
  • Article
  • Open Access
25 Citations
8,308 Views
17 Pages

19 May 2022

The latest research in computer vision highlighted the effectiveness of the vision transformers (ViT) in performing several computer vision tasks; they can efficiently understand and process the image globally unlike the convolution which processes t...

(This article belongs to the Special Issue Artificial Intelligence in Computer Vision: Methods and Applications)
  • Article
  • Open Access
5 Citations
2,350 Views
18 Pages

Fine-Grained Fault Sensitivity Analysis of Vision Transformers Under Soft Errors

  • Jiajun He,
  • Yi Liu,
  • Changqing Xu,
  • Xinfang Liao and
  • Yintang Yang

Over the past decade, deep neural networks (DNNs) have revolutionized the fields of computer vision (CV) and natural language processing (NLP), achieving unprecedented performance across a variety of tasks. The Vision Transformer (ViT) has emerged as...

  • Article
  • Open Access
45 Citations
6,490 Views
26 Pages

9 December 2022

The major cause of death worldwide is due to cardiovascular disorders (CVDs). For a proper diagnosis of CVD disease, an inexpensive solution based on phonocardiogram (PCG) signals is proposed. (1) Background: Currently, a few deep learning (DL)-based...

(This article belongs to the Special Issue AI/ML-Based Medical Image Processing and Analysis)
  • Article
  • Open Access
4 Citations
2,889 Views
30 Pages

Vision Transformers achieve strong performance across computer vision tasks but suffer from quadratic computational complexity with respect to token count, limiting deployment in resource-constrained environments. Existing token pruning methods rely...

(This article belongs to the Section Probability and Statistics)
  • Feature Paper
  • Article
  • Open Access
37 Citations
15,794 Views
43 Pages

Explainability and Evaluation of Vision Transformers: An In-Depth Experimental Study

  • Sédrick Stassin,
  • Valentin Corduant,
  • Sidi Ahmed Mahmoudi and
  • Xavier Siebert

30 December 2023

In the era of artificial intelligence (AI), the deployment of intelligent systems for autonomous decision making has surged across diverse fields. However, the widespread adoption of AI technology is hindered by the risks associated with ceding contr...

(This article belongs to the Section Computer Science & Engineering)
  • Article
  • Open Access
7 Citations
1,977 Views
13 Pages

Vision Transformers for Efficient Indoor Pathloss Radio Map Prediction

  • Rafayel Mkrtchyan,
  • Edvard Ghukasyan,
  • Khoren Petrosyan,
  • Hrant Khachatrian and
  • Theofanis P. Raptis

Indoor pathloss prediction is a fundamental task in wireless network planning, yet it remains challenging due to environmental complexity and data scarcity. In this work, we propose a deep learning-based approach utilizing a vision transformer (ViT)...

(This article belongs to the Special Issue Localization, Navigation, and Channel Modeling: AI Solutions for Complex Indoor and Urban Environments)
  • Review
  • Open Access
625 Citations
67,456 Views
17 Pages

28 April 2023

Transformers are models that implement a mechanism of self-attention, individually weighting the importance of each part of the input data. Their use in image classification tasks is still somewhat limited since researchers have so far chosen Convolu...

(This article belongs to the Special Issue Artificial Intelligence in Complex Networks)
  • Article
  • Open Access
15 Citations
3,603 Views
14 Pages

13 September 2023

Hazard detection is fundamental for a safe lunar landing. State-of-the-art autonomous lunar hazard detection relies on 2D image-based and 3D Lidar systems. The lunar south pole is challenging for vision-based methods. The low sun inclination and the...

(This article belongs to the Section Sensing and Imaging)
  • Article
  • Open Access
21 Citations
4,431 Views
16 Pages

21 September 2022

Gait is a unique biometric trait with several useful properties. It can be recognized remotely and without the cooperation of the individual, with low-resolution cameras, and it is difficult to obscure. Therefore, it is suitable for crime investigati...

(This article belongs to the Section Intelligent Sensors)
  • Article
  • Open Access
3 Citations
2,019 Views
31 Pages

19 January 2026

Fingerprint recognition systems have relied on fragile workflows based on minutiae extraction, which suffer from significant performance losses under real-world conditions such as sensor diversity and low image quality. This study introduces a fully...

(This article belongs to the Topic New Challenges in Image Processing and Pattern Recognition)
  • Article
  • Open Access
1,009 Views
25 Pages

24 May 2026

While Vision Transformers (ViTs) have achieved state-of-the-art (SOTA) results in visual recognition, their scalability remains fundamentally constrained by the quadratic complexity of global self-attention. To address this, we present a linear compl...

  • Article
  • Open Access
52 Citations
8,785 Views
25 Pages

Large-Scale Date Palm Tree Segmentation from Multiscale UAV-Based and Aerial Images Using Deep Vision Transformers

  • Mohamed Barakat A. Gibril,
  • Helmi Zulhaidi Mohd Shafri,
  • Rami Al-Ruzouq,
  • Abdallah Shanableh and ,
  • Faten Nahas and
  • Saeed Al Mansoori
  • + 1 author+ 0 author

29 January 2023

The reliable and efficient large-scale mapping of date palm trees from remotely sensed data is crucial for developing palm tree inventories, continuous monitoring, vulnerability assessments, environmental control, and long-term management. Given the...

  • Article
  • Open Access
85 Citations
6,196 Views
14 Pages

1 November 2022

Convolutional neural networks (CNNs) have enhanced ultrasound image-based early breast cancer detection. Vision transformers (ViTs) have recently surpassed CNNs as the most effective method for natural image analysis. ViTs have proven their capabilit...

(This article belongs to the Special Issue Breast Cancer Metastasis, Diagnostic and Therapeutic Approaches 2022)
  • Article
  • Open Access
1 Citations
958 Views
18 Pages

Softmax is a step in transformer computation during which the internal buffer size grows rapidly because of the use of the exponential function. Softmax is a fundamental yet computationally expensive operation in vision transformer attention, posing...

  • Article
  • Open Access
1,607 Views
17 Pages

On Segment-Aware Monocular Depth Estimation Using Vision Transformers

  • Vasileios Arampatzakis,
  • George Pavlidis,
  • Nikolaos Mitianoudis and
  • Nikos Papamarkos

2 February 2026

Monocular Depth Estimation (MDE) infers per-pixel scene geometry from a single RGB image. Despite recent progress, global MDE models often blur depth discontinuities at object boundaries and fail to capture object-level structure. Segment-aware depth...

  • Article
  • Open Access
24 Citations
5,484 Views
26 Pages

A Comparative Survey of Vision Transformers for Feature Extraction in Texture Analysis

  • Leonardo Scabini,
  • Andre Sacilotti,
  • Kallil M. Zielinski,
  • Lucas C. Ribas and ,
  • Bernard De Baets and
  • Odemir M. Bruno
  • + 1 author+ 0 author

5 September 2025

Texture, a significant visual attribute in images, plays an important role in many pattern recognition tasks. While Convolutional Neural Networks (CNNs) have been among the most effective methods for texture analysis, alternative architectures such a...

(This article belongs to the Special Issue Celebrating the 10th Anniversary of the Journal of Imaging)
  • Article
  • Open Access
267 Citations
18,807 Views
14 Pages

Classification of Brain Tumor from Magnetic Resonance Imaging Using Vision Transformers Ensembling

  • Sudhakar Tummala,
  • Seifedine Kadry,
  • Syed Ahmad Chan Bukhari and
  • Hafiz Tayyab Rauf

7 October 2022

The automated classification of brain tumors plays an important role in supporting radiologists in decision making. Recently, vision transformer (ViT)-based deep neural network architectures have gained attention in the computer vision research domai...

  • Article
  • Open Access
7 Citations
2,216 Views
22 Pages

Depth-Based Intervention Detection in the Neonatal Intensive Care Unit Using Vision Transformers

  • Zein Hajj-Ali,
  • Yasmina Souley Dosso,
  • Kim Greenwood,
  • JoAnn Harrold and
  • James R. Green

4 December 2024

Depth cameras can provide an effective, noncontact, and privacy-preserving means to monitor patients in the Neonatal Intensive Care Unit (NICU). Clinical interventions and routine care events can disrupt video-based patient monitoring. Automatically...

(This article belongs to the Special Issue Machine Learning and Image-Based Smart Sensing and Applications)
  • Article
  • Open Access
13 Citations
2,934 Views
23 Pages

Using neural networks has become the standard technique for medical diagnostics, especially in cancer detection and classification. This work evaluates the performance of Vision Transformer architectures, including Swin Transformer and MaxViT, for se...

(This article belongs to the Special Issue Convolutional Neural Networks and Vision Applications, 4th Edition)
  • Article
  • Open Access
29 Citations
5,627 Views
28 Pages

7 January 2025

The transition from Industry 4.0 to Industry 5.0 gives more prominence to human-centered and sustainable manufacturing practices. This paper proposes a conceptual design framework based on Vision Transformers (ViTs) and digital twins, to meet the dem...

(This article belongs to the Section Advanced Manufacturing)
  • Article
  • Open Access
5 Citations
3,089 Views
19 Pages

R-Cut: Enhancing Explainability in Vision Transformers with Relationship Weighted Out and Cut

  • Yingjie Niu,
  • Ming Ding,
  • Maoning Ge,
  • Robin Karlsson and ,
  • Yuxiao Zhang,
  • Alexander Carballo and
  • Kazuya Takeda
  • + 2 authors+ 0 author

24 April 2024

Transformer-based models have gained popularity in the field of natural language processing (NLP) and are extensively utilized in computer vision tasks and multi-modal models such as GPT4. This paper presents a novel method to enhance the explainabil...

(This article belongs to the Section Sensing and Imaging)
  • Article
  • Open Access
25 Citations
5,171 Views
16 Pages

Optimizing Strawberry Disease and Quality Detection with Vision Transformers and Attention-Based Convolutional Neural Networks

  • Kimia Aghamohammadesmaeilketabforoosh,
  • Soodeh Nikan,
  • Giorgio Antonini and
  • Joshua M. Pearce

14 June 2024

Machine learning and computer vision have proven to be valuable tools for farmers to streamline their resource utilization to lead to more sustainable and efficient agricultural production. These techniques have been applied to strawberry cultivation...

(This article belongs to the Section Plant Foods)
  • Article
  • Open Access
6 Citations
2,714 Views
21 Pages

Clinical Application of Vision Transformers for Melanoma Classification: A Multi-Dataset Evaluation Study

  • Antony Garcia,
  • Jixing Zhou,
  • Gabriela Pinero-Crespo,
  • Thomas Beachkofsky and
  • Xinming Huang

28 October 2025

Background: Melanoma is one of the most lethal skin cancers, with survival rates largely dependent on early detection, yet diagnosis remains difficult because of its visual similarity to benign nevi. Convolutional neural networks have achieved strong...

(This article belongs to the Topic Machine Learning and Deep Learning in Medical Imaging)
  • Article
  • Open Access
1 Citations
2,468 Views
16 Pages

Traditional systems typically require different models for processing different modalities, such as one model for RGB images and another for depth images. Recent research has demonstrated that a single model for one modality can be adapted for anothe...

(This article belongs to the Special Issue Artificial Intelligence in Image Processing and Computer Vision)
  • Article
  • Open Access
537 Views
18 Pages

AMGAA: Attention-Guided Multi-Target Generative Adversarial Attack for Vision Transformers

  • Dongbo Ou,
  • Jintian Lu,
  • Shihui Zhou,
  • Ying Zeng and ,
  • Dongwan Liao,
  • Haoyin Liu,
  • Chao Yang,
  • Yingsheng He and
  • Jie Tian
  • + 4 authors+ 0 author

12 June 2026

Vision Transformers (ViTs) have achieved strong performance in computer vision, but their adversarial robustness remains underexplored. Existing ViT-oriented attacks mainly rely on iterative optimization, leading to high generation cost and limited t...

of 83