Sensors 2014, 14(9), 15861-15879; https://doi.org/10.3390/s140915861
Evaluation of Prompted Annotation of Activity Data Recorded from a Smart Phone
Ian Cleland 1,*
, Manhyung Han 2, Chris Nugent 1
, Hosung Lee 2, Sally McClean 3, Shuai Zhang 1 and Sungyoung Lee 2
, Hosung Lee 2, Sally McClean 3, Shuai Zhang 1 and Sungyoung Lee 21
School of Computing and Mathematics, Computer Science Research Institute, University of Ulster, Newtownabbey, Co. Antrim, BT37 0QB, Northern Ireland, UK
2
Ubiquitous Computing Laboratory, Kyung Hee University, 1 Seocheon-dong, Giheung-gu, Yongin-si, Gyeonggi-do 446-701, Korea
3
School of Computing and Information Engineering, University of Ulster, Coleraine, Co. Londonderry, BT52 1SA, UK
*
Author to whom correspondence should be addressed.
Received: 15 April 2014 / Revised: 31 July 2014 / Accepted: 5 August 2014 / Published: 27 August 2014
(This article belongs to the Special Issue Select Papers from UCAmI & IWAAL 2013 - the 7th International Conference on Ubiquitous Computing and Ambient Intelligence & the 5th International Workshop on Ambient Assisted Living (UCAmI & IWAAL 2013: Pervasive Sensing Solutions)
Abstract
In this paper we discuss the design and evaluation of a mobile based tool to collect activity data on a large scale. The current approach, based on an existing activity recognition module, recognizes class transitions from a set of specific activities (for example walking and running) to the standing still activity. Once this transition is detected the system prompts the user to provide a label for their previous activity. This label, along with the raw sensor data, is then stored locally prior to being uploaded to cloud storage. The system was evaluated by ten users. Three evaluation protocols were used, including a structured, semi-structured and free living protocol. Results indicate that the mobile application could be used to allow the user to provide accurate ground truth labels for their activity data. Similarities of up to 100% where observed when comparing the user prompted labels and those from an observer during structured lab based experiments. Further work will examine data segmentation and personalization issues in order to refine the system. View Full-TextKeywords:
activity recognition; ground truth acquisition; experience sampling; accelerometry; big data; mobile sensing; participatory sensing; opportunistic sensing
▼
Figures
Graphical abstract
This is an open access article distributed under the Creative Commons Attribution License (CC BY 3.0).
Share & Cite This Article
MDPI and ACS Style
Cleland, I.; Han, M.; Nugent, C.; Lee, H.; McClean, S.; Zhang, S.; Lee, S. Evaluation of Prompted Annotation of Activity Data Recorded from a Smart Phone. Sensors 2014, 14, 15861-15879.