Skip to Content

404 Results Found

  • Article
  • Open Access
3 Citations
3,106 Views
17 Pages

29 January 2025

As human and fully automatic live captioning methods coexist and compete against one another, quality analyses and certification become essential. A case in point is LiRICS, the Live Respeaking International Certification Standard created by the Gali...

(This article belongs to the Special Issue Computational Linguistics: From Text to Speech Technologies)
  • Article
  • Open Access
5 Citations
3,605 Views
21 Pages

13 June 2024

The rapid advancement of sensor technologies and deep learning has significantly advanced the field of image captioning, especially for complex scenes. Traditional image captioning methods are often unable to handle the intricacies and detailed relat...

(This article belongs to the Section Sensing and Imaging)
  • Article
  • Open Access
32 Citations
7,934 Views
15 Pages

To automatically generate accurate and meaningful textual descriptions of images is an ongoing research challenge. Recently, a lot of progress has been made by adopting multimodal deep learning approaches for integrating vision and language. However,...

(This article belongs to the Special Issue Fine Art Pattern Extraction and Recognition)
  • Article
  • Open Access
7 Citations
3,524 Views
18 Pages

17 April 2025

This study investigates how Chinese EFL (English as a foreign language) learners of low- and high-proficiency levels allocate attention between captions and audio while watching videos, and how visual complexity (single- vs. multi-speaker content) in...

(This article belongs to the Special Issue Educational Applications of Cognitive Psychology)
  • Article
  • Open Access
9 Citations
5,334 Views
17 Pages

3 January 2024

This paper presents a novel approach to risk assessment by incorporating image captioning as a fundamental component to enhance the effectiveness of surveillance systems. The proposed surveillance system utilizes image captioning to generate descript...

(This article belongs to the Topic AI and Data-Driven Advancements in Industry 4.0)
  • Article
  • Open Access
70 Citations
7,123 Views
20 Pages

A Multi-Level Attention Model for Remote Sensing Image Captions

  • Yangyang Li,
  • Shuangkang Fang,
  • Licheng Jiao,
  • Ruijiao Liu and
  • Ronghua Shang

13 March 2020

The task of image captioning involves the generation of a sentence that can describe an image appropriately, which is the intersection of computer vision and natural language. Although the research on remote sensing image captions has just started, i...

(This article belongs to the Section Remote Sensing Image Processing)
  • Review
  • Open Access
2 Citations
2,080 Views
20 Pages

Background/Objectives: In mainstream educational settings, deaf and hard-of-hearing (DHH) students may have limited or no access to the spoken lectures and discussions that are central to the hearing majority classroom. Yet, engagement in these educa...

(This article belongs to the Special Issue Breaking Down Listening Barriers for Students with Hearing Difficulties)
  • Article
  • Open Access
66 Citations
8,546 Views
19 Pages

Generating Image Captions Using Bahdanau Attention Mechanism and Transfer Learning

  • Shahnawaz Ayoub,
  • Yonis Gulzar,
  • Faheem Ahmad Reegu and
  • Sherzod Turaev

18 December 2022

Automatic image caption prediction is a challenging task in natural language processing. Most of the researchers have used the convolutional neural network as an encoder and decoder. However, an accurate image caption prediction requires a model to u...

  • Article
  • Open Access
11 Citations
7,702 Views
19 Pages

Enhanced BLIP-2 Optimization Using LoRA for Generating Dashcam Captions

  • Minjun Cho,
  • Sungwoo Kim,
  • Dooho Choi and
  • Yunsick Sung

28 March 2025

Autonomous driving technology has advanced significantly. However, it is challenging to accurately generate captions for driving environment scenes, which involve dynamic elements such as vehicles, traffic signals, road conditions, weather, and the t...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
1 Citations
1,629 Views
17 Pages

The environmental perception capability of intelligent ships is essential for enhancing maritime navigation safety and advancing shipping intelligence. Image caption generation technology plays a pivotal role in this context by converting visual info...

(This article belongs to the Special Issue Unmanned Marine Vehicles: Perception, Planning, Control and Swarm—2nd Edition)
  • Article
  • Open Access
6 Citations
5,929 Views
12 Pages

2 July 2019

Image captioning is a promising research topic that is applicable to services that search for desired content in a large amount of video data and a situation explanation service for visually impaired people. Previous research on image captioning has...

(This article belongs to the Special Issue Advanced Intelligent Imaging Technology)
  • Article
  • Open Access
1 Citations
4,922 Views
22 Pages

23 July 2025

Dense video captioning involves identifying, localizing, and describing multiple events within a video. Capturing temporal and contextual dependencies between events is essential for generating coherent and accurate captions. To effectively capture t...

  • Article
  • Open Access
8 Citations
3,902 Views
16 Pages

Parallel Dense Video Caption Generation with Multi-Modal Features

  • Xuefei Huang,
  • Ka-Hou Chan,
  • Wei Ke and
  • Hao Sheng

26 August 2023

The task of dense video captioning is to generate detailed natural-language descriptions for an original video, which requires deep analysis and mining of semantic captions to identify events in the video. Existing methods typically follow a localisa...

(This article belongs to the Special Issue Hybrid Data Processing by Combining Machine Learning, Expert, Safety and Security)
  • Article
  • Open Access
3 Citations
5,417 Views
20 Pages

Image Captioning Based on Semantic Scenes

  • Fengzhi Zhao,
  • Zhezhou Yu,
  • Tao Wang and
  • Yi Lv

18 October 2024

With the development of artificial intelligence and deep learning technologies, image captioning has become an important research direction at the intersection of computer vision and natural language processing. The purpose of image captioning is to...

(This article belongs to the Collection Entropy in Image Analysis)
  • Data Descriptor
  • Open Access
12 Citations
10,009 Views
27 Pages

#PraCegoVer: A Large Dataset for Image Captioning in Portuguese

  • Gabriel Oliveira dos Santos,
  • Esther Luna Colombini and
  • Sandra Avila

21 January 2022

Automatically describing images using natural sentences is essential to visually impaired people’s inclusion on the Internet. This problem is known as Image Captioning. There are many datasets in the literature, but most contain only English ca...

(This article belongs to the Section Information Systems and Data Management)
  • Article
  • Open Access
7 Citations
8,175 Views
15 Pages

14 February 2023

Image captioning is a problem of viewing images and describing images in language. This is an important problem that can be solved by understanding the image, and combining two fields of image processing and natural language processing into one. The...

  • Article
  • Open Access
1 Citations
3,174 Views
19 Pages

5 November 2024

In recent years, the dance field has been able to create diverse content by leveraging technical advancements such as deep learning models, generating content beyond the unique artistic creations that only humans can create. However, in terms of danc...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
40 Citations
5,106 Views
16 Pages

Fusion of Multi-Modal Features to Enhance Dense Video Caption

  • Xuefei Huang,
  • Ka-Hou Chan,
  • Weifan Wu,
  • Hao Sheng and
  • Wei Ke

14 June 2023

Dense video caption is a task that aims to help computers analyze the content of a video by generating abstract captions for a sequence of video frames. However, most of the existing methods only use visual features in the video and ignore the audio...

(This article belongs to the Special Issue Deep Learning for Information Fusion and Pattern Recognition)
  • Article
  • Open Access
43 Citations
3,978 Views
25 Pages

MIRA-CAP: Memory-Integrated Retrieval-Augmented Captioning for State-of-the-Art Image and Video Captioning

  • Sabina Umirzakova,
  • Shakhnoza Muksimova,
  • Sevara Mardieva,
  • Murodjon Sultanov Baxtiyarovich and
  • Young-Im Cho

15 December 2024

Generating accurate and contextually rich captions for images and videos is essential for various applications, from assistive technology to content recommendation. However, challenges such as maintaining temporal coherence in videos, reducing noise...

(This article belongs to the Section Sensing and Imaging)
  • Article
  • Open Access
9 Citations
4,752 Views
14 Pages

Image-Captioning Model Compression

  • Viktar Atliha and
  • Dmitrij Šešok

4 February 2022

Image captioning is a very important task, which is on the edge between natural language processing (NLP) and computer vision (CV). The current quality of the captioning models allows them to be used for practical tasks, but they require both large c...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
1 Citations
4,586 Views
14 Pages

Towards Human-Interactive Controllable Video Captioning with Efficient Modeling

  • Yoonseok Heo,
  • Taehoon Kim,
  • Seunghwan Kim,
  • Jungyun Seo and
  • Juae Kim

30 June 2024

Video captioning is a task of describing the visual scene of a given video in natural language. There have been several lines of research focused on developing large-scale models in a transfer learning paradigm, with major challenge being the tradeof...

(This article belongs to the Special Issue Advanced Artificial Intelligence Models and Its Applications, 2nd Edition)
  • Article
  • Open Access
2 Citations
3,241 Views
16 Pages

20 July 2023

Image captioning is a challenging task, which generates a sentence for a given image. The earlier captioning methods mainly decode the visual features to generate caption sentences for the image. However, the visual features lack the context semantic...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
14 Citations
5,966 Views
17 Pages

Arabic Captioning for Images of Clothing Using Deep Learning

  • Rasha Saleh Al-Malki and
  • Arwa Yousuf Al-Aama

7 April 2023

Fashion is one of the many fields of application that image captioning is being used in. For e-commerce websites holding tens of thousands of images of clothing, automated item descriptions are quite desirable. This paper addresses captioning images...

(This article belongs to the Section Intelligent Sensors)
  • Article
  • Open Access
30 Citations
9,101 Views
13 Pages

Image Captioning Using Motion-CNN with Object Detection

  • Kiyohiko Iwamura,
  • Jun Younes Louhi Kasahara,
  • Alessandro Moro,
  • Atsushi Yamashita and
  • Hajime Asama

10 February 2021

Automatic image captioning has many important applications, such as the depiction of visual contents for visually impaired people or the indexing of images on the internet. Recently, deep learning-based image captioning models have been researched ex...

(This article belongs to the Section Intelligent Sensors)
  • Article
  • Open Access
10 Citations
4,826 Views
16 Pages

Video Caption Based Searching Using End-to-End Dense Captioning and Sentence Embeddings

  • Akshay Aggarwal,
  • Aniruddha Chauhan,
  • Deepika Kumar,
  • Mamta Mittal and ,
  • Sudipta Roy and
  • Tai-hoon Kim
  • + 1 author+ 0 author

10 June 2020

Traditionally, searching for videos on popular streaming sites like YouTube is performed by taking the keywords, titles, and descriptions that are already tagged along with the video into consideration. However, the video content is not utilized for...

  • Article
  • Open Access
21 Citations
4,533 Views
16 Pages

CapERA: Captioning Events in Aerial Videos

  • Laila Bashmal,
  • Yakoub Bazi,
  • Mohamad Mahmoud Al Rahhal,
  • Mansour Zuair and
  • Farid Melgani

18 April 2023

In this paper, we introduce the CapERA dataset, which upgrades the Event Recognition in Aerial Videos (ERA) dataset to aerial video captioning. The newly proposed dataset aims to advance visual–language-understanding tasks for UAV videos by pro...

(This article belongs to the Section Remote Sensing Image Processing)
  • Article
  • Open Access
17 Citations
5,884 Views
24 Pages

ACapMed: Automatic Captioning for Medical Imaging

  • Djamila Romaissa Beddiar,
  • Mourad Oussalah,
  • Tapio Seppänen and
  • Rachid Jennane

1 November 2022

Medical image captioning is a very challenging task that has been rarely addressed in the literature on natural image captioning. Some existing image captioning techniques exploit objects present in the image next to the visual features while generat...

(This article belongs to the Special Issue Recent Trends in Automatic Image Captioning Systems)
  • Article
  • Open Access
1 Citations
2,327 Views
17 Pages

Novel Object Captioning with Semantic Match from External Knowledge

  • Sen Du,
  • Hong Zhu,
  • Guangfeng Lin,
  • Dong Wang and
  • Jing Shi

4 July 2023

Automatically describing the content of an image is a challenging task that is on the edge between natural language and computer vision. The current image caption models can describe the objects that are frequently seen in the training set very well,...

  • Article
  • Open Access
99 Citations
10,491 Views
11 Pages

Captioning Transformer with Stacked Attention Modules

  • Xinxin Zhu,
  • Lixiang Li,
  • Jing Liu,
  • Haipeng Peng and
  • Xinxin Niu

Image captioning is a challenging task. Meanwhile, it is important for the machine to understand the meaning of an image better. In recent years, the image captioning usually use the long-short-term-memory (LSTM) as the decoder to generate the senten...

  • Article
  • Open Access
1 Citations
4,893 Views
18 Pages

28 November 2024

This article presents CapFlow, an integrated approach to detailed image captioning and hashtag generation. Based on a thorough performance evaluation, the image captioning model utilizes a fine-tuned vision-language model with Low-Rank Adaptation (Lo...

(This article belongs to the Section Smart System Infrastructure and Applications)
  • Review
  • Open Access
55 Citations
11,407 Views
20 Pages

A Systematic Literature Review on Image Captioning

  • Raimonda Staniūtė and
  • Dmitrij Šešok

16 May 2019

Natural language problems have already been investigated for around five years. Recent progress in artificial intelligence (AI) has greatly improved the performance of models. However, the results are still not sufficiently satisfying. Machines canno...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Review
  • Open Access
32 Citations
13,199 Views
38 Pages

A Review of Transformer-Based Approaches for Image Captioning

  • Oscar Ondeng,
  • Heywood Ouma and
  • Peter Akuon

9 October 2023

Visual understanding is a research area that bridges the gap between computer vision and natural language processing. Image captioning is a visual understanding task in which natural language descriptions of images are automatically generated using v...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Systematic Review
  • Open Access
12 Citations
5,729 Views
31 Pages

30 September 2023

With the explosion of visual content on the Internet, creating captions for images has become a necessary task and an exciting topic for many researchers. Furthermore, image captioning is becoming increasingly important as the number of people utiliz...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
22 Citations
6,534 Views
16 Pages

Fashion-Oriented Image Captioning with External Knowledge Retrieval and Fully Attentive Gates

  • Nicholas Moratelli,
  • Manuele Barraco,
  • Davide Morelli,
  • Marcella Cornia and ,
  • Lorenzo Baraldi and
  • Rita Cucchiara
  • + 1 author+ 0 author

23 January 2023

Research related to fashion and e-commerce domains is gaining attention in computer vision and multimedia communities. Following this trend, this article tackles the task of generating fine-grained and accurate natural language descriptions of fashio...

(This article belongs to the Special Issue Computer Vision in Human Analysis: From Face and Body to Clothes)
  • Article
  • Open Access
3 Citations
3,336 Views
18 Pages

25 February 2025

To address the issue in encoder–decoder-based video captioning method where semantic topics are overlooked in guiding the video captioning, leading to a semantic mismatch between video content and generated captions, a video captioning method b...

  • Article
  • Open Access
744 Views
20 Pages

13 May 2026

Recent image captioning methods based on pre-trained vision–language models can generate fluent and coherent descriptions, yet they still struggle in open-domain scenes that contain long-tail concepts, uncommon object combinations, and ambiguou...

(This article belongs to the Section E1: Mathematics and Computer Science)
  • Article
  • Open Access
2 Citations
4,494 Views
17 Pages

4 October 2020

In this work, we propose a novel priors-based attention neural network (PANN) for image captioning, which aims at incorporating two kinds of priors, i.e., the probabilities being mentioned for local region proposals (PBM priors) and part-of-speech cl...

(This article belongs to the Special Issue The Applications of Context Awareness Computing and Image Understanding)
  • Article
  • Open Access
8 Citations
5,126 Views
20 Pages

Caps Captioning: A Modern Image Captioning Approach Based on Improved Capsule Network

  • Shima Javanmardi,
  • Ali Mohammad Latif,
  • Mohammad Taghi Sadeghi,
  • Mehrdad Jahanbanifard and ,
  • Marcello Bonsangue and
  • Fons J. Verbeek
  • + 1 author+ 0 author

1 November 2022

In image captioning models, the main challenge in describing an image is identifying all the objects by precisely considering the relationships between the objects and producing various captions. Over the past few years, many methods have been propos...

(This article belongs to the Collection Advances in Deep-Learning-Based Sensing, Imaging, and Video Processing)
  • Article
  • Open Access
6 Citations
3,716 Views
14 Pages

An Image Captioning Algorithm Based on Combination Attention Mechanism

  • Jinlong Liu,
  • Kangda Cheng,
  • Haiyan Jin and
  • Zhilu Wu

With the maturity of computer vision and natural language processing technology, we are becoming more ambitious in image captioning. In particular, we are more ambitious in generating longer, richer, and more accurate sentences as image descriptions....

(This article belongs to the Section Computer Science & Engineering)
  • Article
  • Open Access
14 Citations
5,938 Views
13 Pages

Social Image Captioning: Exploring Visual Attention and User Attention

  • Leiquan Wang,
  • Xiaoliang Chu,
  • Weishan Zhang,
  • Yiwei Wei and ,
  • Weichen Sun and
  • Chunlei Wu
  • + 1 author+ 0 author

22 February 2018

Image captioning with a natural language has been an emerging trend. However, the social image, associated with a set of user-contributed tags, has been rarely investigated for a similar task. The user-contributed tags, which could reflect the user a...

(This article belongs to the Special Issue Sensing, Data Analysis and Platforms for Ubiquitous Intelligence)
  • Article
  • Open Access
3 Citations
3,199 Views
17 Pages

30 April 2022

With the increase in the performance of deep learning models, the model parameter has increased exponentially. An increase in model parameters leads to an increase in computation and training time, i.e., an increase in training cost. To reduce the tr...

(This article belongs to the Section Intelligent Sensors)
  • Article
  • Open Access
4 Citations
3,470 Views
14 Pages

30 November 2021

Image captioning generates written descriptions of an image. In recent image captioning research, attention regions seldom cover all objects, and generated captions may lack the details of objects and may remain far from reality. In this paper, we pr...

(This article belongs to the Section Sensing and Imaging)
  • Article
  • Open Access
7 Citations
3,649 Views
16 Pages

30 November 2020

Compared with traditional image captioning technology, stylized image captioning has broader application scenarios, such as a better understanding of images. However, stylized image captioning faces many challenges, the most important of which is how...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
6 Citations
4,148 Views
23 Pages

An Attentive Fourier-Augmented Image-Captioning Transformer

  • Raymond Ian Osolo,
  • Zhan Yang and
  • Jun Long

9 September 2021

Many vision–language models that output natural language, such as image-captioning models, usually use image features merely for grounding the captions and most of the good performance of the model can be attributed to the language model, which does...

  • Article
  • Open Access
21 Citations
6,567 Views
20 Pages

Cross-Modal Retrieval and Semantic Refinement for Remote Sensing Image Captioning

  • Zhengxin Li,
  • Wenzhe Zhao,
  • Xuanyi Du,
  • Guangyao Zhou and
  • Songlin Zhang

3 January 2024

Two-stage remote sensing image captioning (RSIC) methods have achieved promising results by incorporating additional pre-trained remote sensing tasks to extract supplementary information and improve caption quality. However, these methods face limita...

(This article belongs to the Special Issue Deep Learning in Optical Satellite Images)
  • Article
  • Open Access
19 Citations
5,714 Views
29 Pages

Self-Learning for Few-Shot Remote Sensing Image Captioning

  • Haonan Zhou,
  • Xiaoping Du,
  • Lurui Xia and
  • Sen Li

15 September 2022

Large-scale caption-labeled remote sensing image samples are expensive to acquire, and the training samples available in practical application scenarios are generally limited. Therefore, remote sensing image caption generation tasks will inevitably f...

(This article belongs to the Section Remote Sensing Image Processing)
  • Article
  • Open Access
3 Citations
2,883 Views
18 Pages

Separate Syntax and Semantics: Part-of-Speech-Guided Transformer for Image Captioning

  • Dong Wang,
  • Bing Liu,
  • Yong Zhou,
  • Mingming Liu and ,
  • Peng Liu and
  • Rui Yao
  • + 1 author+ 0 author

22 November 2022

Transformer-based image captioning models have recently achieved remarkable performance by using new fully attentive paradigms. However, existing models generally follow the conventional language model of predicting the next word conditioned on the v...

(This article belongs to the Topic Computer Vision and Image Processing)
  • Article
  • Open Access
9 Citations
3,676 Views
16 Pages

25 June 2022

Video captioning via encoder–decoder structures is a successful sentence generation method. In addition, using various feature extraction networks for extracting multiple features to obtain multiple kinds of visual features in the encoding proc...

(This article belongs to the Section Sensing and Imaging)
  • Article
  • Open Access
3 Citations
1,767 Views
17 Pages

17 May 2025

Despite advances in image captioning, existing models struggle to generate captions that include accurate numerical information, especially the number of objects. One reason for this issue is that the dataset used for training has a limited number of...

  • Article
  • Open Access
6 Citations
3,031 Views
12 Pages

MFVC: Urban Traffic Scene Video Caption Based on Multimodal Fusion

  • Mingxing Li,
  • Hao Zhang,
  • Cheng Xu,
  • Chenyang Yan and ,
  • Hongzhe Liu and
  • Xuewei Li
  • + 1 author+ 0 author

21 September 2022

With the development of electronic technology, intelligent cars can gradually realize more complex artificial intelligence algorithms. The video caption algorithm is one of them. However, current video caption algorithms only consider single-visual i...

(This article belongs to the Special Issue Multimodal Signal, Image and Video Analysis and Application)

of 9