Next Article in Journal
Out-of-Plane Continuous Electrostatic Micro-Power Generators
Previous Article in Journal
A Prosthetic Hand Body Area Controller Based on Efficient Pattern Recognition Control Strategies
Open AccessArticle

Cross-Spectral Local Descriptors via Quadruplet Network

1
Computer Vision Center, Edifici O, Campus UAB, Bellaterra 08193, Barcelona, Spain
2
Computer Science Department, Universitat Autònoma de Barcelona, Campus UAB, Bellaterra 08193,Barcelona, Spain
3
Facultad de Ingeniería en Electricidad y Computación, CIDIS, Escuela Superior Politécnica del Litoral,ESPOL, Campus Gustavo Galindo, Km 30.5 vía Perimetral, Guayaquil 09-01-5863, Ecuador
4
DIEE, University of Bío-Bío, Concepción 4051381, Concepción, Chile
*
Author to whom correspondence should be addressed.
Sensors 2017, 17(4), 873; https://doi.org/10.3390/s17040873
Received: 10 March 2017 / Revised: 3 April 2017 / Accepted: 7 April 2017 / Published: 15 April 2017
(This article belongs to the Section Physical Sensors)
This paper presents a novel CNN-based architecture, referred to as Q-Net, to learn local feature descriptors that are useful for matching image patches from two different spectral bands. Given correctly matched and non-matching cross-spectral image pairs, a quadruplet network is trained to map input image patches to a common Euclidean space, regardless of the input spectral band. Our approach is inspired by the recent success of triplet networks in the visible spectrum, but adapted for cross-spectral scenarios, where, for each matching pair, there are always two possible non-matching patches: one for each spectrum. Experimental evaluations on a public cross-spectral VIS-NIR dataset shows that the proposed approach improves the state-of-the-art. Moreover, the proposed technique can also be used in mono-spectral settings, obtaining a similar performance to triplet network descriptors, but requiring less training data. View Full-Text
Keywords: cross-spectral; descriptor; infrared; CNN cross-spectral; descriptor; infrared; CNN
Show Figures

Figure 1

MDPI and ACS Style

Aguilera, C.A.; Sappa, A.D.; Aguilera, C.; Toledo, R. Cross-Spectral Local Descriptors via Quadruplet Network. Sensors 2017, 17, 873. https://doi.org/10.3390/s17040873

AMA Style

Aguilera CA, Sappa AD, Aguilera C, Toledo R. Cross-Spectral Local Descriptors via Quadruplet Network. Sensors. 2017; 17(4):873. https://doi.org/10.3390/s17040873

Chicago/Turabian Style

Aguilera, Cristhian A.; Sappa, Angel D.; Aguilera, Cristhian; Toledo, Ricardo. 2017. "Cross-Spectral Local Descriptors via Quadruplet Network" Sensors 17, no. 4: 873. https://doi.org/10.3390/s17040873

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Search more from Scilit
 
Search
Back to TopTop