Video analysis for identifying human operation difficulties and faucet usability assessment

Authors:
Babak Taati;Jasper Snoek;Alex Mihailidis
Affiliations:
Intelligent Assistive Technology and Systems Lab, University of Toronto, Canada and Toronto Rehabilitation Institute, Canada;Intelligent Assistive Technology and Systems Lab, University of Toronto, Canada;Intelligent Assistive Technology and Systems Lab, University of Toronto, Canada and Toronto Rehabilitation Institute, Canada
Venue:
Neurocomputing
Year:
2013

Citing 11
Cited 0

Fundamentals of speech recognition

Fundamentals of speech recognition
Usability Engineering

Usability Engineering
Combining Statistical Learning with a Knowledge-Based Approach - A Case Study in Intensive Care Monitoring

ICML '99 Proceedings of the Sixteenth International Conference on Machine Learning
Histograms of Oriented Gradients for Human Detection

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
On Space-Time Interest Points

International Journal of Computer Vision
Large Margin Methods for Structured and Interdependent Output Variables

The Journal of Machine Learning Research
Learning to recognise behaviours of persons with dementia using multiple cues in an HMM-based approach

Proceedings of the 2nd International Conference on PErvasive Technologies Related to Assistive Environments
Water Flow Detection in a Handwashing Task

CRV '10 Proceedings of the 2010 Canadian Conference on Computer and Robot Vision
A vision-based system for automatic hand washing quality assessment

Machine Vision and Applications
Human detection using oriented histograms of flow and appearance

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part II
The use of computer vision in an intelligent environment to support aging-in-place, safety, and independence in the home

IEEE Transactions on Information Technology in Biomedicine

Quantified Score

Hi-index	0.01

Visualization

Abstract

As the world struggles to cope with a growing elderly population, concerns of how to preserve independence are becoming increasingly acute. A major hurdle to independent living is the inability to use everyday household objects. This work aims to automate the assessment of product usability for the elderly population using the tools of computer vision and machine learning. A novel video analysis technique is presented that performs temporal segmentation of video containing human-product interaction and automatically identifies time segments in which the human has difficulties in operating the product. The method has applications in the automatic assessment of the usability of various product designs via measuring the frequency of operation difficulties. The approach is applied to a case study of water faucet design for the older adult population with dementia. Experiments in the automatic analysis of a large database of real-world recorded videos confirm the effectiveness of the approach in providing valid temporal segmentation (accuracy 88.1%) and in the correct estimation of the relative advantage (or disadvantage) of one design over another in terms of operation difficulties in performing various actions.