Next Article in Journal
Building Solar Cells from Nanocrystal Inks
Next Article in Special Issue
EDCrammer: An Efficient Caching Rate-Control Algorithm for Streaming Data on Resource-Limited Edge Nodes
Previous Article in Journal
Monitoring of the Human Body Signal through the Internet of Things (IoT) Based LoRa Wireless Network System
Previous Article in Special Issue
Evolutionary Algorithms to Optimize Task Scheduling Problem for the IoT Based Bag-of-Tasks Application in Cloud–Fog Computing Environment
Open AccessArticle

A Smart System for Text-Lifelog Generation from Wearable Cameras in Smart Environment Using Concept-Augmented Image Captioning with Modified Beam Search Strategy

Information Technology and Software Engineering Lab, VNUHCM—University of Science, Ho Chi Minh 800010, Vietnam
*
Authors to whom correspondence should be addressed.
This article is an extended research of our previous work “Personal Diary Generation from Wearable Cameras with Concept Augmented Image Captioning and Wide Trail Strategy”, awarded as “Best Paper” in Symposium on Information and Communication Technology conference (SoICT 2018), DaNang City, Viet Nam, 6–7 December 2018.
Appl. Sci. 2019, 9(9), 1886; https://doi.org/10.3390/app9091886
Received: 2 March 2019 / Revised: 28 April 2019 / Accepted: 29 April 2019 / Published: 8 May 2019
(This article belongs to the Special Issue Edge Computing Applications in IoT)
During a lifetime, a person can have many wonderful and memorable moments that he/she wants to keep. With the development of technology, people now can store a massive amount of lifelog information via images, videos or texts. Inspired by this, we develop a system to automatically generate caption from lifelog pictures taken from wearable cameras. Following up on our previous method introduced at the SoICT 2018 conference, we propose two improvements in our captioning method. We trained and tested the model on the baseline MSCOCO datasets and evaluated on different metrics. The results show better performance compared to our previous model and to some other image captioning methods. Our system also shows effectiveness in retrieving relevant data from captions and achieve high rank in ImageCLEF 2018 retrieval challenge. View Full-Text
Keywords: lifelog processing; image captioning; IoT system lifelog processing; image captioning; IoT system
Show Figures

Figure 1

MDPI and ACS Style

Vo-Ho, V.-K.; Luong, Q.-A.; Nguyen, D.-T.; Tran, M.-K.; Tran, M.-T. A Smart System for Text-Lifelog Generation from Wearable Cameras in Smart Environment Using Concept-Augmented Image Captioning with Modified Beam Search Strategy. Appl. Sci. 2019, 9, 1886.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Search more from Scilit
 
Search
Back to TopTop