Next Article in Journal
Oscillation Attenuation in a Building-like Structure by Using a Flexible Vibration Absorber
Previous Article in Journal
Estimation of the Instantaneous Reproduction Number and Its Confidence Interval for Modeling the COVID-19 Pandemic
Previous Article in Special Issue
Unified Mathematical Formulation of Monogenic Phase Congruency
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Modeling of Hyperparameter Tuned Deep Learning Model for Automated Image Captioning

1
Deanship of Scientific Research, King Abdulaziz University, Jeddah 21589, Saudi Arabia
2
Mathematics Department, Faculty of Science, Taif University, Taif 21944, Saudi Arabia
3
Mathematics Department, Faculty of Science, Sohag University, Sohag 82524, Egypt
4
Department of Mathematics, Faculty of Science, Taif University, Taif 21944, Saudi Arabia
5
Mathematics Department, Faculty of Science, Azhar University, Cairo 11884, Egypt
6
Physics Department, Faculty of Science, Taif University, Taif 21944, Saudi Arabia
7
Department of Computer Science and Engineering, Sejong University, Seoul 05006, Korea
*
Author to whom correspondence should be addressed.
Mathematics 2022, 10(3), 288; https://doi.org/10.3390/math10030288
Submission received: 19 November 2021 / Revised: 11 January 2022 / Accepted: 11 January 2022 / Published: 18 January 2022
(This article belongs to the Special Issue Mathematical Approaches to Image Processing with Applications)

Abstract

Image processing remains a hot research topic among research communities due to its applicability in several areas. An important application of image processing is the automatic image captioning technique, which intends to generate a proper description of an image in a natural language automated. Image captioning is a recently developed hot research topic, and it started to receive significant attention in the field of computer vision and natural language processing (NLP). Since image captioning is considered a challenging task, the recently developed deep learning (DL) models have attained significant performance with increased complexity and computational cost. Keeping these issues in mind, in this paper, a novel hyperparameter tuned DL for automated image captioning (HPTDL-AIC) technique is proposed. The HPTDL-AIC technique encompasses two major parts, namely encoder and decoder. The encoder part utilizes Faster SqueezNet with the RMSProp model to generate an effective depiction of the input image via insertion into a predefined length vector. At the same time, the decoder unit employs a bird swarm algorithm (BSA) with long short-term memory (LSTM) model to concentrate on the generation of description sentences. The design of RMSProp and BSA for the hyperparameter tuning process of the Faster SqueezeNet and LSTM models for image captioning shows the novelty of the work, which helps to accomplish enhanced image captioning performance. The experimental validation of the HPTDL-AIC technique is carried out against two benchmark datasets, and the extensive comparative study pointed out the improved performance of the HPTDL-AIC technique over recent approaches.
Keywords: image captioning; deep learning; machine learning; encoder; decoder; hyperparameter tuning image captioning; deep learning; machine learning; encoder; decoder; hyperparameter tuning

Share and Cite

MDPI and ACS Style

Omri, M.; Abdel-Khalek, S.; Khalil, E.M.; Bouslimi, J.; Joshi, G.P. Modeling of Hyperparameter Tuned Deep Learning Model for Automated Image Captioning. Mathematics 2022, 10, 288. https://doi.org/10.3390/math10030288

AMA Style

Omri M, Abdel-Khalek S, Khalil EM, Bouslimi J, Joshi GP. Modeling of Hyperparameter Tuned Deep Learning Model for Automated Image Captioning. Mathematics. 2022; 10(3):288. https://doi.org/10.3390/math10030288

Chicago/Turabian Style

Omri, Mohamed, Sayed Abdel-Khalek, Eied M. Khalil, Jamel Bouslimi, and Gyanendra Prasad Joshi. 2022. "Modeling of Hyperparameter Tuned Deep Learning Model for Automated Image Captioning" Mathematics 10, no. 3: 288. https://doi.org/10.3390/math10030288

APA Style

Omri, M., Abdel-Khalek, S., Khalil, E. M., Bouslimi, J., & Joshi, G. P. (2022). Modeling of Hyperparameter Tuned Deep Learning Model for Automated Image Captioning. Mathematics, 10(3), 288. https://doi.org/10.3390/math10030288

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop