Next Article in Journal
Automated Prostate Gland Segmentation Based on an Unsupervised Fuzzy C-Means Clustering Technique Using Multispectral T1w and T2w MR Imaging
Previous Article in Journal
Developing Knowledge-Based Citizen Participation Platform to Support Smart City Decision Making: The Smarticipate Case Study
Article Menu

Export Article

Open AccessArticle
Information 2017, 8(2), 48;

Assembling Deep Neural Networks for Medical Compound Figure Detection

School of Computer Science and Technology, Dalian University of Technology, Dalian 116024, China
School of Computer Science & Engineering, Dalian Minzu University, Dalian 116600, China
School of Software Engineering, Dalian University of Foreign Language, Dalian 116044, China
Author to whom correspondence should be addressed.
Academic Editor: Willy Susilo
Received: 17 March 2017 / Revised: 18 April 2017 / Accepted: 19 April 2017 / Published: 21 April 2017
Full-Text   |   PDF [850 KB, uploaded 21 April 2017]   |  


Compound figure detection on figures and associated captions is the first step to making medical figures from biomedical literature available for further analysis. The performance of traditional methods is limited to the choice of hand-engineering features and prior domain knowledge. We train multiple convolutional neural networks (CNNs), long short-term memory (LSTM) networks, and gated recurrent unit (GRU) networks on top of pre-trained word vectors to learn textual features from captions and employ deep CNNs to learn visual features from figures. We then identify compound figures by combining textual and visual prediction. Our proposed architecture obtains remarkable performance in three run types—textual, visual and mixed—and achieves better performance in ImageCLEF2015 and ImageCLEF2016. View Full-Text
Keywords: compound figure detection; convolutional neural network; recurrent neural network; word vectors compound figure detection; convolutional neural network; recurrent neural network; word vectors

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Share & Cite This Article

MDPI and ACS Style

Yu, Y.; Lin, H.; Meng, J.; Wei, X.; Zhao, Z. Assembling Deep Neural Networks for Medical Compound Figure Detection. Information 2017, 8, 48.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Information EISSN 2078-2489 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top