Next Article in Journal
Out-of-Plane Continuous Electrostatic Micro-Power Generators
Previous Article in Journal
A Prosthetic Hand Body Area Controller Based on Efficient Pattern Recognition Control Strategies
Article Menu
Issue 4 (April) cover image

Export Article

Open AccessArticle
Sensors 2017, 17(4), 873;

Cross-Spectral Local Descriptors via Quadruplet Network

Computer Vision Center, Edifici O, Campus UAB, Bellaterra 08193, Barcelona, Spain
Computer Science Department, Universitat Autònoma de Barcelona, Campus UAB, Bellaterra 08193,Barcelona, Spain
Facultad de Ingeniería en Electricidad y Computación, CIDIS, Escuela Superior Politécnica del Litoral,ESPOL, Campus Gustavo Galindo, Km 30.5 vía Perimetral, Guayaquil 09-01-5863, Ecuador
DIEE, University of Bío-Bío, Concepción 4051381, Concepción, Chile
Author to whom correspondence should be addressed.
Received: 10 March 2017 / Revised: 3 April 2017 / Accepted: 7 April 2017 / Published: 15 April 2017
(This article belongs to the Section Physical Sensors)
Full-Text   |   PDF [1057 KB, uploaded 18 April 2017]   |  


This paper presents a novel CNN-based architecture, referred to as Q-Net, to learn local feature descriptors that are useful for matching image patches from two different spectral bands. Given correctly matched and non-matching cross-spectral image pairs, a quadruplet network is trained to map input image patches to a common Euclidean space, regardless of the input spectral band. Our approach is inspired by the recent success of triplet networks in the visible spectrum, but adapted for cross-spectral scenarios, where, for each matching pair, there are always two possible non-matching patches: one for each spectrum. Experimental evaluations on a public cross-spectral VIS-NIR dataset shows that the proposed approach improves the state-of-the-art. Moreover, the proposed technique can also be used in mono-spectral settings, obtaining a similar performance to triplet network descriptors, but requiring less training data. View Full-Text
Keywords: cross-spectral; descriptor; infrared; CNN cross-spectral; descriptor; infrared; CNN

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Share & Cite This Article

MDPI and ACS Style

Aguilera, C.A.; Sappa, A.D.; Aguilera, C.; Toledo, R. Cross-Spectral Local Descriptors via Quadruplet Network. Sensors 2017, 17, 873.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top