Digital Comics Image Indexing Based on Deep Learning
AbstractThe digital comic book market is growing every year now, mixing digitized and digital-born comics. Digitized comics suffer from a limited automatic content understanding which restricts online content search and reading applications. This study shows how to combine state-of-the-art image analysis methods to encode and index images into an XML-like text file. Content description file can then be used to automatically split comic book images into sub-images corresponding to panels easily indexable with relevant information about their respective content. This allows advanced search in keywords said by specific comic characters, action and scene retrieval using natural language processing. We get down to panel, balloon, text, comic character and face detection using traditional approaches and breakthrough deep learning models, and also text recognition using LSTM model. Evaluations on a dataset composed of online library content are presented, and a new public dataset is also proposed. View Full-Text
Share & Cite This Article
Nguyen, N.-V.; Rigaud, C.; Burie, J.-C. Digital Comics Image Indexing Based on Deep Learning. J. Imaging 2018, 4, 89.
Nguyen N-V, Rigaud C, Burie J-C. Digital Comics Image Indexing Based on Deep Learning. Journal of Imaging. 2018; 4(7):89.Chicago/Turabian Style
Nguyen, Nhu-Van; Rigaud, Christophe; Burie, Jean-Christophe. 2018. "Digital Comics Image Indexing Based on Deep Learning." J. Imaging 4, no. 7: 89.
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.