Skip to Content
You are currently on the new version of our website. Access the old version .

400 Results Found

  • Article
  • Open Access
6 Citations
5,925 Views
12 Pages

2 July 2019

Image captioning is a promising research topic that is applicable to services that search for desired content in a large amount of video data and a situation explanation service for visually impaired people. Previous research on image captioning has...

(This article belongs to the Special Issue Advanced Intelligent Imaging Technology)
  • Article
  • Open Access
3 Citations
5,409 Views
20 Pages

Image Captioning Based on Semantic Scenes

  • Fengzhi Zhao,
  • Zhezhou Yu,
  • Tao Wang and
  • Yi Lv

18 October 2024

With the development of artificial intelligence and deep learning technologies, image captioning has become an important research direction at the intersection of computer vision and natural language processing. The purpose of image captioning is to...

(This article belongs to the Collection Entropy in Image Analysis)
  • Article
  • Open Access
9 Citations
4,737 Views
14 Pages

Image-Captioning Model Compression

  • Viktar Atliha and
  • Dmitrij Šešok

4 February 2022

Image captioning is a very important task, which is on the edge between natural language processing (NLP) and computer vision (CV). The current quality of the captioning models allows them to be used for practical tasks, but they require both large c...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
43 Citations
3,956 Views
25 Pages

MIRA-CAP: Memory-Integrated Retrieval-Augmented Captioning for State-of-the-Art Image and Video Captioning

  • Sabina Umirzakova,
  • Shakhnoza Muksimova,
  • Sevara Mardieva,
  • Murodjon Sultanov Baxtiyarovich and
  • Young-Im Cho

15 December 2024

Generating accurate and contextually rich captions for images and videos is essential for various applications, from assistive technology to content recommendation. However, challenges such as maintaining temporal coherence in videos, reducing noise...

(This article belongs to the Section Sensing and Imaging)
  • Article
  • Open Access
7 Citations
8,161 Views
15 Pages

14 February 2023

Image captioning is a problem of viewing images and describing images in language. This is an important problem that can be solved by understanding the image, and combining two fields of image processing and natural language processing into one. The...

  • Data Descriptor
  • Open Access
12 Citations
9,969 Views
27 Pages

#PraCegoVer: A Large Dataset for Image Captioning in Portuguese

  • Gabriel Oliveira dos Santos,
  • Esther Luna Colombini and
  • Sandra Avila

21 January 2022

Automatically describing images using natural sentences is essential to visually impaired people’s inclusion on the Internet. This problem is known as Image Captioning. There are many datasets in the literature, but most contain only English ca...

(This article belongs to the Section Information Systems and Data Management)
  • Article
  • Open Access
8 Citations
5,118 Views
20 Pages

Caps Captioning: A Modern Image Captioning Approach Based on Improved Capsule Network

  • Shima Javanmardi,
  • Ali Mohammad Latif,
  • Mohammad Taghi Sadeghi,
  • Mehrdad Jahanbanifard and ,
  • Marcello Bonsangue and
  • Fons J. Verbeek
  • + 1 author+ 0 author

1 November 2022

In image captioning models, the main challenge in describing an image is identifying all the objects by precisely considering the relationships between the objects and producing various captions. Over the past few years, many methods have been propos...

(This article belongs to the Collection Advances in Deep-Learning-Based Sensing, Imaging, and Video Processing)
  • Article
  • Open Access
21 Citations
4,521 Views
16 Pages

CapERA: Captioning Events in Aerial Videos

  • Laila Bashmal,
  • Yakoub Bazi,
  • Mohamad Mahmoud Al Rahhal,
  • Mansour Zuair and
  • Farid Melgani

18 April 2023

In this paper, we introduce the CapERA dataset, which upgrades the Event Recognition in Aerial Videos (ERA) dataset to aerial video captioning. The newly proposed dataset aims to advance visual–language-understanding tasks for UAV videos by pro...

(This article belongs to the Section Remote Sensing Image Processing)
  • Article
  • Open Access
17 Citations
5,880 Views
24 Pages

ACapMed: Automatic Captioning for Medical Imaging

  • Djamila Romaissa Beddiar,
  • Mourad Oussalah,
  • Tapio Seppänen and
  • Rachid Jennane

1 November 2022

Medical image captioning is a very challenging task that has been rarely addressed in the literature on natural image captioning. Some existing image captioning techniques exploit objects present in the image next to the visual features while generat...

(This article belongs to the Special Issue Recent Trends in Automatic Image Captioning Systems)
  • Article
  • Open Access
99 Citations
10,482 Views
11 Pages

Captioning Transformer with Stacked Attention Modules

  • Xinxin Zhu,
  • Lixiang Li,
  • Jing Liu,
  • Haipeng Peng and
  • Xinxin Niu

Image captioning is a challenging task. Meanwhile, it is important for the machine to understand the meaning of an image better. In recent years, the image captioning usually use the long-short-term-memory (LSTM) as the decoder to generate the senten...

  • Article
  • Open Access
1 Citations
4,885 Views
18 Pages

28 November 2024

This article presents CapFlow, an integrated approach to detailed image captioning and hashtag generation. Based on a thorough performance evaluation, the image captioning model utilizes a fine-tuned vision-language model with Low-Rank Adaptation (Lo...

(This article belongs to the Section Smart System Infrastructure and Applications)
  • Article
  • Open Access
2 Citations
3,235 Views
16 Pages

20 July 2023

Image captioning is a challenging task, which generates a sentence for a given image. The earlier captioning methods mainly decode the visual features to generate caption sentences for the image. However, the visual features lack the context semantic...

(This article belongs to the Section Artificial Intelligence)
  • Review
  • Open Access
55 Citations
11,395 Views
20 Pages

A Systematic Literature Review on Image Captioning

  • Raimonda Staniūtė and
  • Dmitrij Šešok

16 May 2019

Natural language problems have already been investigated for around five years. Recent progress in artificial intelligence (AI) has greatly improved the performance of models. However, the results are still not sufficiently satisfying. Machines canno...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
1 Citations
4,901 Views
22 Pages

23 July 2025

Dense video captioning involves identifying, localizing, and describing multiple events within a video. Capturing temporal and contextual dependencies between events is essential for generating coherent and accurate captions. To effectively capture t...

  • Article
  • Open Access
14 Citations
5,954 Views
17 Pages

Arabic Captioning for Images of Clothing Using Deep Learning

  • Rasha Saleh Al-Malki and
  • Arwa Yousuf Al-Aama

7 April 2023

Fashion is one of the many fields of application that image captioning is being used in. For e-commerce websites holding tens of thousands of images of clothing, automated item descriptions are quite desirable. This paper addresses captioning images...

(This article belongs to the Section Intelligent Sensors)
  • Article
  • Open Access
30 Citations
9,095 Views
13 Pages

Image Captioning Using Motion-CNN with Object Detection

  • Kiyohiko Iwamura,
  • Jun Younes Louhi Kasahara,
  • Alessandro Moro,
  • Atsushi Yamashita and
  • Hajime Asama

10 February 2021

Automatic image captioning has many important applications, such as the depiction of visual contents for visually impaired people or the indexing of images on the internet. Recently, deep learning-based image captioning models have been researched ex...

(This article belongs to the Section Intelligent Sensors)
  • Review
  • Open Access
32 Citations
13,182 Views
38 Pages

A Review of Transformer-Based Approaches for Image Captioning

  • Oscar Ondeng,
  • Heywood Ouma and
  • Peter Akuon

9 October 2023

Visual understanding is a research area that bridges the gap between computer vision and natural language processing. Image captioning is a visual understanding task in which natural language descriptions of images are automatically generated using v...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
1 Citations
4,579 Views
14 Pages

Towards Human-Interactive Controllable Video Captioning with Efficient Modeling

  • Yoonseok Heo,
  • Taehoon Kim,
  • Seunghwan Kim,
  • Jungyun Seo and
  • Juae Kim

30 June 2024

Video captioning is a task of describing the visual scene of a given video in natural language. There have been several lines of research focused on developing large-scale models in a transfer learning paradigm, with major challenge being the tradeof...

(This article belongs to the Special Issue Advanced Artificial Intelligence Models and Its Applications, 2nd Edition)
  • Article
  • Open Access
1 Citations
2,324 Views
17 Pages

Novel Object Captioning with Semantic Match from External Knowledge

  • Sen Du,
  • Hong Zhu,
  • Guangfeng Lin,
  • Dong Wang and
  • Jing Shi

4 July 2023

Automatically describing the content of an image is a challenging task that is on the edge between natural language and computer vision. The current image caption models can describe the objects that are frequently seen in the training set very well,...

  • Article
  • Open Access
1 Citations
3,159 Views
19 Pages

5 November 2024

In recent years, the dance field has been able to create diverse content by leveraging technical advancements such as deep learning models, generating content beyond the unique artistic creations that only humans can create. However, in terms of danc...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
4 Citations
3,462 Views
14 Pages

30 November 2021

Image captioning generates written descriptions of an image. In recent image captioning research, attention regions seldom cover all objects, and generated captions may lack the details of objects and may remain far from reality. In this paper, we pr...

(This article belongs to the Section Sensing and Imaging)
  • Article
  • Open Access
3 Citations
3,328 Views
18 Pages

25 February 2025

To address the issue in encoder–decoder-based video captioning method where semantic topics are overlooked in guiding the video captioning, leading to a semantic mismatch between video content and generated captions, a video captioning method b...

  • Article
  • Open Access
6 Citations
4,142 Views
23 Pages

An Attentive Fourier-Augmented Image-Captioning Transformer

  • Raymond Ian Osolo,
  • Zhan Yang and
  • Jun Long

9 September 2021

Many vision–language models that output natural language, such as image-captioning models, usually use image features merely for grounding the captions and most of the good performance of the model can be attributed to the language model, which does...

  • Article
  • Open Access
6 Citations
3,710 Views
14 Pages

An Image Captioning Algorithm Based on Combination Attention Mechanism

  • Jinlong Liu,
  • Kangda Cheng,
  • Haiyan Jin and
  • Zhilu Wu

With the maturity of computer vision and natural language processing technology, we are becoming more ambitious in image captioning. In particular, we are more ambitious in generating longer, richer, and more accurate sentences as image descriptions....

(This article belongs to the Section Computer Science & Engineering)
  • Article
  • Open Access
9 Citations
3,674 Views
16 Pages

25 June 2022

Video captioning via encoder–decoder structures is a successful sentence generation method. In addition, using various feature extraction networks for extracting multiple features to obtain multiple kinds of visual features in the encoding proc...

(This article belongs to the Section Sensing and Imaging)
  • Article
  • Open Access
19 Citations
5,702 Views
29 Pages

Self-Learning for Few-Shot Remote Sensing Image Captioning

  • Haonan Zhou,
  • Xiaoping Du,
  • Lurui Xia and
  • Sen Li

15 September 2022

Large-scale caption-labeled remote sensing image samples are expensive to acquire, and the training samples available in practical application scenarios are generally limited. Therefore, remote sensing image caption generation tasks will inevitably f...

(This article belongs to the Section Remote Sensing Image Processing)
  • Article
  • Open Access
4 Citations
6,663 Views
18 Pages

Panoptic Segmentation-Based Attention for Image Captioning

  • Wenjie Cai,
  • Zheng Xiong,
  • Xianfang Sun,
  • Paul L. Rosin and ,
  • Longcun Jin and
  • Xinyi Peng
  • + 1 author+ 0 author

4 January 2020

Image captioning is the task of generating textual descriptions of images. In order to obtain a better image representation, attention mechanisms have been widely adopted in image captioning. However, in existing models with detection-based attention...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
14 Citations
5,933 Views
13 Pages

Social Image Captioning: Exploring Visual Attention and User Attention

  • Leiquan Wang,
  • Xiaoliang Chu,
  • Weishan Zhang,
  • Yiwei Wei and ,
  • Weichen Sun and
  • Chunlei Wu
  • + 1 author+ 0 author

22 February 2018

Image captioning with a natural language has been an emerging trend. However, the social image, associated with a set of user-contributed tags, has been rarely investigated for a similar task. The user-contributed tags, which could reflect the user a...

(This article belongs to the Special Issue Sensing, Data Analysis and Platforms for Ubiquitous Intelligence)
  • Proceeding Paper
  • Open Access
1 Citations
2,455 Views
7 Pages

Preliminary Study on Image Captioning for Construction Hazards

  • Wen-Ta Hsiao,
  • Wen-Der Yu,
  • Tao-Ming Cheng and
  • Alexey Bulgakov

Construction accidents are a major contributor to occupational fatalities. To tackle this issue, improved monitoring for hazard elimination is crucial. By introducing a deep-learning image captioning system, we identified hazards via closed-circuit t...

(This article belongs to the Proceedings of 2024 IEEE 4th International Conference on Electronic Communications, Internet of Things and Big Data)
  • Article
  • Open Access
10 Citations
4,820 Views
16 Pages

Video Caption Based Searching Using End-to-End Dense Captioning and Sentence Embeddings

  • Akshay Aggarwal,
  • Aniruddha Chauhan,
  • Deepika Kumar,
  • Mamta Mittal and ,
  • Sudipta Roy and
  • Tai-hoon Kim
  • + 1 author+ 0 author

10 June 2020

Traditionally, searching for videos on popular streaming sites like YouTube is performed by taking the keywords, titles, and descriptions that are already tagged along with the video into consideration. However, the video content is not utilized for...

  • Article
  • Open Access
3 Citations
3,194 Views
17 Pages

30 April 2022

With the increase in the performance of deep learning models, the model parameter has increased exponentially. An increase in model parameters leads to an increase in computation and training time, i.e., an increase in training cost. To reduce the tr...

(This article belongs to the Section Intelligent Sensors)
  • Article
  • Open Access
726 Views
20 Pages

13 May 2026

Recent image captioning methods based on pre-trained vision–language models can generate fluent and coherent descriptions, yet they still struggle in open-domain scenes that contain long-tail concepts, uncommon object combinations, and ambiguou...

(This article belongs to the Section E1: Mathematics and Computer Science)
  • Article
  • Open Access
13 Citations
3,228 Views
18 Pages

Full-Memory Transformer for Image Captioning

  • Tongwei Lu,
  • Jiarong Wang and
  • Fen Min

9 January 2023

The Transformer-based approach represents the state-of-the-art in image captioning. However, existing studies have shown Transformer has a problem that irrelevant tokens with overlapping neighbors incorrectly attend to each other with relatively larg...

  • Article
  • Open Access
22 Citations
6,521 Views
16 Pages

Fashion-Oriented Image Captioning with External Knowledge Retrieval and Fully Attentive Gates

  • Nicholas Moratelli,
  • Manuele Barraco,
  • Davide Morelli,
  • Marcella Cornia and ,
  • Lorenzo Baraldi and
  • Rita Cucchiara
  • + 1 author+ 0 author

23 January 2023

Research related to fashion and e-commerce domains is gaining attention in computer vision and multimedia communities. Following this trend, this article tackles the task of generating fine-grained and accurate natural language descriptions of fashio...

(This article belongs to the Special Issue Computer Vision in Human Analysis: From Face and Body to Clothes)
  • Article
  • Open Access
3 Citations
1,754 Views
17 Pages

17 May 2025

Despite advances in image captioning, existing models struggle to generate captions that include accurate numerical information, especially the number of objects. One reason for this issue is that the dataset used for training has a limited number of...

  • Article
  • Open Access
7 Citations
3,644 Views
16 Pages

30 November 2020

Compared with traditional image captioning technology, stylized image captioning has broader application scenarios, such as a better understanding of images. However, stylized image captioning faces many challenges, the most important of which is how...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
21 Citations
6,547 Views
20 Pages

Cross-Modal Retrieval and Semantic Refinement for Remote Sensing Image Captioning

  • Zhengxin Li,
  • Wenzhe Zhao,
  • Xuanyi Du,
  • Guangyao Zhou and
  • Songlin Zhang

3 January 2024

Two-stage remote sensing image captioning (RSIC) methods have achieved promising results by incorporating additional pre-trained remote sensing tasks to extract supplementary information and improve caption quality. However, these methods face limita...

(This article belongs to the Special Issue Deep Learning in Optical Satellite Images)
  • Article
  • Open Access
19 Citations
6,247 Views
18 Pages

Indoor Scene Change Captioning Based on Multimodality Data

  • Yue Qiu,
  • Yutaka Satoh,
  • Ryota Suzuki,
  • Kenji Iwata and
  • Hirokatsu Kataoka

23 August 2020

This study proposes a framework for describing a scene change using natural language text based on indoor scene observations conducted before and after a scene change. The recognition of scene changes plays an essential role in a variety of real-worl...

(This article belongs to the Special Issue Sensor Signal and Information Processing III)
  • Article
  • Open Access
4 Citations
1,399 Views
22 Pages

Image captioning is a cross-task of computer vision and natural language processing, aiming to describe image content in natural language. Existing methods still have deficiencies in modeling the spatial location and semantic correlation between imag...

(This article belongs to the Special Issue AI/Machine Learning in Computer Vision/Image Processing and Natural Language Processing)
  • Article
  • Open Access
3 Citations
2,875 Views
18 Pages

Separate Syntax and Semantics: Part-of-Speech-Guided Transformer for Image Captioning

  • Dong Wang,
  • Bing Liu,
  • Yong Zhou,
  • Mingming Liu and ,
  • Peng Liu and
  • Rui Yao
  • + 1 author+ 0 author

22 November 2022

Transformer-based image captioning models have recently achieved remarkable performance by using new fully attentive paradigms. However, existing models generally follow the conventional language model of predicting the next word conditioned on the v...

(This article belongs to the Topic Computer Vision and Image Processing)
  • Systematic Review
  • Open Access
12 Citations
5,716 Views
31 Pages

30 September 2023

With the explosion of visual content on the Internet, creating captions for images has become a necessary task and an exciting topic for many researchers. Furthermore, image captioning is becoming increasingly important as the number of people utiliz...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
6 Citations
2,875 Views
16 Pages

Semantic-Enhanced Cross-Modal Fusion for Improved Unsupervised Image Captioning

  • Nan Xiang,
  • Ling Chen,
  • Leiyan Liang,
  • Xingdi Rao and
  • Zehao Gong

22 August 2023

Unsupervised image captioning often grapples with challenges such as image–text mismatches and modality gaps, resulting in suboptimal captions. This paper introduces a semantic-enhanced cross-modal fusion model (SCFM) to address these issues. T...

  • Article
  • Open Access
16 Citations
3,624 Views
14 Pages

9 June 2020

The encoder–decoder framework has been widely used in the remote sensing image captioning task. When we need to extract remote sensing images containing specific characteristics from the described sentences for research, rich sentences can impr...

  • Article
  • Open Access
17 Citations
9,823 Views
15 Pages

Enhanced Image Captioning with Color Recognition Using Deep Learning Methods

  • Yeong-Hwa Chang,
  • Yen-Jen Chen,
  • Ren-Hung Huang and
  • Yi-Ting Yu

26 December 2021

Automatically describing the content of an image is an interesting and challenging task in artificial intelligence. In this paper, an enhanced image captioning model—including object detection, color analysis, and image captioning—is prop...

(This article belongs to the Special Issue Integrated Artificial Intelligence in Data Science)
  • Article
  • Open Access
10 Citations
3,890 Views
18 Pages

1 March 2024

Image captioning is important for improving the intelligence of construction projects and assisting managers in mastering construction site activities. However, there are few image-captioning models for construction scenes at present, and the existin...

(This article belongs to the Special Issue Application of Information Theory to Computer Vision and Image Processing II)
  • Article
  • Open Access
2 Citations
1,536 Views
16 Pages

27 October 2024

Image captioning aims to describe the content in an image, which plays a critical role in image understanding. Existing methods tend to generate the text for more distinct natural images. These models can not be well for paintings containing more abs...

(This article belongs to the Topic Computer Vision and Image Processing, 2nd Edition)
  • Article
  • Open Access
16 Citations
3,259 Views
18 Pages

11 March 2024

Image captioning is a technique used to generate descriptive captions for images. Typically, it involves employing a Convolutional Neural Network (CNN) as the encoder to extract visual features, and a decoder model, often based on Recurrent Neural Ne...

(This article belongs to the Special Issue Feature Papers in the 'Sensor Networks' Section 2023)
  • Article
  • Open Access
18 Citations
4,784 Views
20 Pages

Modeling of Hyperparameter Tuned Deep Learning Model for Automated Image Captioning

  • Mohamed Omri,
  • Sayed Abdel-Khalek,
  • Eied M. Khalil,
  • Jamel Bouslimi and
  • Gyanendra Prasad Joshi

18 January 2022

Image processing remains a hot research topic among research communities due to its applicability in several areas. An important application of image processing is the automatic image captioning technique, which intends to generate a proper descripti...

(This article belongs to the Special Issue Mathematical Approaches to Image Processing with Applications)
  • Article
  • Open Access
11 Citations
2,462 Views
19 Pages

22 May 2024

In the field of remote sensing image captioning (RSIC), mainstream methods typically adopt an encoder–decoder framework. Methods based on this framework often use only simple feature fusion strategies, failing to fully mine the fine-grained fea...

(This article belongs to the Section Remote Sensing Image Processing)
  • Article
  • Open Access
36 Citations
6,898 Views
11 Pages

Text Augmentation Using BERT for Image Captioning

  • Viktar Atliha and
  • Dmitrij Šešok

28 August 2020

Image captioning is an important task for improving human-computer interaction as well as for a deeper understanding of the mechanisms underlying the image description by human. In recent years, this research field has rapidly developed and a number...

(This article belongs to the Section Computing and Artificial Intelligence)

of 8