Next Article in Journal
Geospatial Data Processing for Biometeorology. Mapping the Difference of Oxygen in the Atmospheric Surface
Previous Article in Journal
A Deep Convolutional Neural Network to Detect the Existence of Geospatial Elements in High-Resolution Aerial Imagery
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Proceedings
Volume 19
Issue 1
10.3390/proceedings2019019018
proceedings-logo
Submit to this Journal
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Proceeding Paper

Development of Computer Vision Applications to Automate the Measurement of the Dimensions of Skin Wounds †

by
David Sánchez-Jiménez
1,
Fernando Buchón-Moragues
1,*,
Begoña Escutia-Muñoz
2 and
Rafael Botella-Estrada
2
1
Departamento de Ingeniería Geodésica, Cartográfica y Topográfica, Universitat Politècnica de València, 46022 València, Spain
2
Servicio de Dermatología, Hospital Universitari i Politècnic La Fe de València, 46009 València, Spain
*
Author to whom correspondence should be addressed.
†
Presented at the II Congress in Geomatics Engineering, Madrid, Spain, 26–27 June 2019.
Proceedings 2019, 19(1), 18; https://doi.org/10.3390/proceedings2019019018
Published: 16 July 2019
(This article belongs to the Proceedings of The II Geomatics Engineering Conference)
Browse Figures
Versions Notes

Abstract

:
This paper shows the progress in the development of two computer vision applications for measuring skin wounds. Both applications have been written in Python programming language and make use of OpenCV and Scipy open source libraries. Their objective is to be part of a software that calculates the dimensions of skin wounds in an objective and reliable way. This could be useful in the clinical follow-up, assessing the evolution of skin wounds, as well as in research, comparing the efficacy of different treatments. Merging these two applications into a single one would allow to generate two-dimensional results in real time, and three-dimensional results after a few hours of processing.

1. Introduction

Biomedical applications have great potential in the field of geomatics, since techniques such as photogrammetry and remote sensing can be used as supplementary tests for various measurements, which are useful in the clinical follow-up of patients and in research [1,2,3,4,5].
Our line of research focuses on the area of dermatology, specifically on the measurement of the dimensions of skin wounds. The procedures include the following successive stages: taking photographs; reconstructing the 3D model from them; removing the noise in that model; defining the wound contour; interpolating the reference surface using the healthy skin; measuring the dimensions of the wound and presenting the results as a report for their interpretation as complementary tests by the medical specialist.
In previous projects we developed the procedures for taking photographs and measuring the dimensions of skin wounds, using digital cameras and photogrammetric scanning software based on correlation. We tested our technique in a randomised clinical trial. We also created a system of applications to automate the presentation of results, including a website prototype to store them, testing it with data from 50 leg ulcers [6,7,8,9,10,11].
This project tries to go one step further, developing two computer vision applications in order to improve the automation of the definition of the wound contour, and to simplify the measurement of the dimensions of skin wounds and the presentation of results.

2. Justification and Objectives

The delimitation of the wound contour is a crucial aspect in the measurement of its dimensions. The manual definition of this contour is subjective, so it is an added source of imprecision to that of the measurement method itself. The measurement of this contour has an inter-observer variability, and even intra-observer variability, due to factors such as position and angle of the photograph, lighting and user’s ability to reproduce this measurement. Therefore, it would be useful to develop an application that could determine the contour of the wound in an objective and consistent way.
In addition, it is necessary to automate the procedure for measuring the dimensions of the wounds and presenting results, in order to accelerate their evaluation by health personnel.

3. Method and Results

3.1. Application 1

This application (Figure 1) has a photograph of the skin wound as input data. It semiautomatically detects the contour and measures the following dimensions: circularity ratio, maximum length, perimeter and surface area. Its execution time is less than 5 min. The output is a report in PDF format with: photograph of the skin wound, its contour and dimensions.
The application workflow includes the following sequential steps:
  • Select the photograph of the wound. JPG and PNG formats are supported.
  • Scale the image. It supports two options: the manual option, in which the user selects two points on the image and records the distance in mm between them, and the automatic option, in which the application automatically detects markers with certain characteristics of shape, color and size.
  • Determine the wound contour. It has two stages: in the first stage, the user manually sets a rectangle that completely encloses the wound, and the application makes a first approach to the wound contour. In the second stage, an iterative process of improvement in the definition of the wound contour is performed, in which the user draws a line where the wound or the healthy skin was wrongly classified. The application fits these requirements and delimits a new contour, using the color differences between the pixels classified as healthy skin and those classified as ulcer.
  • Calculate the dimensions: circularity ratio, maximum length, perimeter and surface area.
  • Save results: report in PDF format with the photograph of the skin wound, its contour and dimensions.

3.2. Application 2

This application (Figure 2) has a video of the skin wound as input data. It semi-automatically detects the contour and measures, in addition to the dimensions of Application 1, the roughness index, the excavated surface and the volume of the skin wound. Its execution time is less than 5 h. The outputs are a three-dimensional model of the skin wound, as well as a report in PDF format similar to the one obtained in Application 1.
The application workflow includes the following sequential steps:
  • Select the video of the wound. AVI and MP4 formats are supported.
  • Upload the video to the server. Its frames are extracted, the best ones (based on the geometry and the sharpness of the photograph) are selected, the 3D model is reconstructed and the point cloud in TXT format is returned to the application.
  • Scale the 3D model. Markers with certain characteristics of shape, color and size are automatically detected. In the current version of the application, the markers are black circles placed on a grid of calibrated paper with a white background. The centroids are identified and the distance between them is scaled.
  • Create an orthophotograph. It has a pixel size of 100 microns and Z, R, G, B data.
  • Translate and rotate the 3D model. The user manually sets a rectangle that completely encloses the wound. The 3D model is translated so that the center of this rectangle matches the origin of the coordinate system. The 3D model is rotated, locating the wound at the top.
  • Determine the wound contour. The procedure is similar to the one in Application 1.
  • Determine the healthy skin contour. A 20 mm buffer is set with respect to the wound contour. This contour can be edited by the user.
  • Interpolate the reference surface, using the healthy skin contour.
  • Calculate the dimensions: circularity ratio, roughness index, maximum length, perimeter, surface area, excavated surface and volume.
  • Save results: 3D model in OBJ format and report in PDF format with: orthophotograph, wound contour and its dimensions.

4. Discussion

The applications described here are in the alpha stage of development. Their functionalities must be improved and their results should be validated against other reference methods before becoming a stable release.
In future versions, both applications will be merged and coded for their use on a mobile phone with Android operating system.
Merging these two applications into a single one would allow to obtain two-dimensional results in real time, and three-dimensional results after a few hours of processing.

5. Conclusions

These unfinished applications have potential usefulness as objective tools: in the clinical followup, assessing the evolution of skin wounds, and in research, comparing the efficacy of different treatments.

Author Contributions

Supervision, F.B.-M. and R.B.-E.; provision of patients, B.E.-M. and R.B.-E.; software development, D.S.-J.; writing of the published work, D.S.-J. and F.B.-M.; conceptualisation, D.S.-J., F.B.-M., B.E.-M. and R.B.-E.

Funding

This work is part of the Ph.D. research of D.S., which is supported by a grant from Generalitat Valenciana—Consellería de Educación, Investigación, Cultura y Deporte and the European Social Fund (ACIF/2018/160).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Wannous, H.; Lucas, Y.; Treuillet, S. Enhanced Assessment of the Wound-Healing Process by Accurate Multiview Tissue Classification. IEEE Trans. Med. Imaging 2011, 30, 315–326. [Google Scholar] [CrossRef] [PubMed]
  2. Mukherjee, R.; Tewary, S.; Routray, A. Diagnostic and Prognostic Utility of Non-Invasive Multimodal Imaging in Chronic Wound Monitoring: A Systematic Review. J. Med. Syst. 2017, 41, 46. [Google Scholar] [CrossRef] [PubMed]
  3. Jorgensen, L.B.; Sorensen, J.A.; Jemec, G.B.E.; Yderstraede, K.B. Methods to assess area and volume of wounds—A systematic review. Int. Wound J. 2016, 13, 540–553. [Google Scholar] [CrossRef]
  4. Pires, I.M.; Garcia, N. Wound Area Assessment using Mobile Application. In Proceedings of the HEALTHINF 2015—International Conference on Health Informatics, Lisbon, Portugal, 12–15 January 2015; pp. 271–282. [Google Scholar] [CrossRef]
  5. Budman, J.; Keenahan, K.; Acharya, S.; Brat, G.A. Design of a Smartphone Application for Automated Wound Measurements in Home Care. Connect. Health Symp. 2015, 1, e16. [Google Scholar] [CrossRef]
  6. Botella, R.; Palomar, J.M.; Escutia, M.B.; Buchón, F.F.; Sánchez-Jiménez, D.; García, A.; Escario, E.; Martínez, M.L. Modelado y medición de úlceras de la piel por técnicas fotogramétricas de objeto cercano (MEDULC). In Proyecto Coordinado UPV-La Fe; Editorial Universitat Politècnica De Valènci: Valènci, Spain, 2015. [Google Scholar]
  7. Martínez, M.L.; Escario, E.; Poblet, E.; Sánchez-Jiménez, D.; Buchón, F.F.; Izeta, A.; Jiménez, F. Hair follicle containing punch grafts accelerate chronic ulcer healing: A randomized controlled trial. J. Am. Acad. Dermatol. 2016, 75, 1007–1014. [Google Scholar] [CrossRef] [PubMed]
  8. Sánchez-Jiménez, D. Aplicaciones médicas de la fotogrametría a la medición de úlceras de la piel. In Proyecto Final de Carrera; Universitat Politècnica de València: Valencia, Spain, 2013. [Google Scholar]
  9. Sánchez-Jiménez, D. Modelado de úlceras de la piel mediante fotogrametría: Escaneado basado en imágenes. In Proyecto Final de Grado; Universitat Politècnica de València: Valencia, Spain, 2014. [Google Scholar]
  10. Buchón, F.F. Sistemas Fotogramétricos Submilimétricos de Adquisición de Datos Tridimensionales Aplicados a la Dermatología. Ph.D. Thesis, Universitat Politècnica de València, Valencia, Spain, 2015. [Google Scholar]
  11. Sánchez-Jiménez, D.; Buchón, F.F.; Palomar, J.M.; Peris, G. Procesamiento automatizado de modelos tridimensionales de úlceras cutáneas. Primer Congr. En Ing. Geomática 2017. [Google Scholar] [CrossRef]
Proceedings 19 00018 g001
Figure 1. Application 1 user interface overview.
Figure 1. Application 1 user interface overview.
Proceedings 19 00018 g001
Proceedings 19 00018 g002
Figure 2. Application 2 user interface overview.
Figure 2. Application 2 user interface overview.
Proceedings 19 00018 g002
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Sánchez-Jiménez, D.; Buchón-Moragues, F.; Escutia-Muñoz, B.; Botella-Estrada, R. Development of Computer Vision Applications to Automate the Measurement of the Dimensions of Skin Wounds. Proceedings 2019, 19, 18. https://doi.org/10.3390/proceedings2019019018

AMA Style

Sánchez-Jiménez D, Buchón-Moragues F, Escutia-Muñoz B, Botella-Estrada R. Development of Computer Vision Applications to Automate the Measurement of the Dimensions of Skin Wounds. Proceedings. 2019; 19(1):18. https://doi.org/10.3390/proceedings2019019018

Chicago/Turabian Style

Sánchez-Jiménez, David, Fernando Buchón-Moragues, Begoña Escutia-Muñoz, and Rafael Botella-Estrada. 2019. "Development of Computer Vision Applications to Automate the Measurement of the Dimensions of Skin Wounds" Proceedings 19, no. 1: 18. https://doi.org/10.3390/proceedings2019019018

APA Style

Sánchez-Jiménez, D., Buchón-Moragues, F., Escutia-Muñoz, B., & Botella-Estrada, R. (2019). Development of Computer Vision Applications to Automate the Measurement of the Dimensions of Skin Wounds. Proceedings, 19(1), 18. https://doi.org/10.3390/proceedings2019019018

Article Metrics

Back to TopTop