Next Article in Journal
Experimental Validation of Smoothed Particle Hydrodynamics on Generation and Propagation of Water Waves
Next Article in Special Issue
Integrating Three-Dimensional Benthic Habitat Characterization Techniques into Ecological Monitoring of Coral Reefs
Previous Article in Journal
Survey on Experimental and Numerical Approaches to Model Underwater Explosions
Previous Article in Special Issue
Semantic Segmentation of Underwater Imagery Using Deep Networks Trained on Synthetic Imagery
Article Menu
Issue 1 (January) cover image

Export Article

Open AccessData Descriptor
J. Mar. Sci. Eng. 2019, 7(1), 16; https://doi.org/10.3390/jmse7010016

CADDY Underwater Stereo-Vision Dataset for Human–Robot Interaction (HRI) in the Context of Diver Activities

1
Robotics Group, Computer Science & Electrical Engineering, Jacobs University Bremen, Campus Ring 1, 28759 Bremen, Germany
2
Institute of Marine Engineering—National Research Council, Via E. De Marini 6, 16149 Genova, Italy
3
Institute for Computational Linguistics—National Research Council, Via E. De Marini 6, 16149 Genova, Italy
4
Faculty of Electrical Engineering and Computing, University of Zagreb, Unska ul. 3, 10000 Zagreb, Croatia
*
Author to whom correspondence should be addressed.
Received: 18 December 2018 / Revised: 4 January 2019 / Accepted: 10 January 2019 / Published: 16 January 2019
(This article belongs to the Special Issue Underwater Imaging)
Full-Text   |   PDF [4724 KB, uploaded 16 January 2019]   |  

Abstract

In this article, we present a novel underwater dataset collected from several field trials within the EU FP7 project “Cognitive autonomous diving buddy (CADDY)”, where an Autonomous Underwater Vehicle (AUV) was used to interact with divers and monitor their activities. To our knowledge, this is one of the first efforts to collect a large public dataset in underwater environments with the purpose of studying and boosting object classification, segmentation and human pose estimation tasks. The first part of the dataset contains stereo camera recordings (≈10 K) of divers performing hand gestures to communicate with an AUV in different environmental conditions. The gestures can be used to test the robustness of visual detection and classification algorithms in underwater conditions, e.g., under color attenuation and light backscatter. The second part includes stereo footage (≈12.7 K) of divers free-swimming in front of the AUV, along with synchronized measurements from Inertial Measurement Units (IMU) located throughout the diver’s suit (DiverNet), which serve as ground-truth for human pose and tracking methods. In both cases, these rectified images allow the investigation of 3D representation and reasoning pipelines from low-texture targets commonly present in underwater scenarios. This work describes the recording platform, sensor calibration procedure plus the data format and the software utilities provided to use the dataset. View Full-Text
Keywords: dataset; underwater imaging; image processing; marine robotics; field robotics; human–robot interaction; stereo vision; object classification; human pose estimation dataset; underwater imaging; image processing; marine robotics; field robotics; human–robot interaction; stereo vision; object classification; human pose estimation
Figures

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Supplementary material

  • Externally hosted supplementary file 1
    Link: http://caddy-underwater-datasets.ge.issia.cnr.it/
    Description: Website that hosts complete datasets and their complete description. All necessary software to parse and use the data is also provided.
SciFeed

Share & Cite This Article

MDPI and ACS Style

Gomez Chavez, A.; Ranieri, A.; Chiarella, D.; Zereik, E.; Babić, A.; Birk, A. CADDY Underwater Stereo-Vision Dataset for Human–Robot Interaction (HRI) in the Context of Diver Activities. J. Mar. Sci. Eng. 2019, 7, 16.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
J. Mar. Sci. Eng. EISSN 2077-1312 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top