Skip to Content
You are currently on the new version of our website. Access the old version .
  • Article
  • Open Access

30 August 2021

32 Pages

Designing a Computer-Vision Application: A Case Study for Hand-Hygiene Assessment in an Open-Room Environment

,
,
and
1
The Elmore Family School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USA
2
Department of Food Science, Purdue University, West Lafayette, IN 47907, USA
*
Author to whom correspondence should be addressed.

Abstract

Hand-hygiene is a critical component for safe food handling. In this paper, we apply an iterative engineering process to design a hand-hygiene action detection system to improve food-handling safety. We demonstrate the feasibility of a baseline RGB-only convolutional neural network (CNN) in the restricted case of a single scenario; however, since this baseline system performs poorly across scenarios, we also demonstrate the application of two methods to explore potential reasons for its poor performance. This leads to the development of our hierarchical system that incorporates a variety of modalities (RGB, optical flow, hand masks, and human skeleton joints) for recognizing subsets of hand-hygiene actions. Using hand-washing video recorded from several locations in a commercial kitchen, we demonstrate the effectiveness of our system for detecting hand hygiene actions in untrimmed videos. In addition, we discuss recommendations for designing a computer vision system for a real application.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.