Gesture spotting with body-worn inertial sensors to detect user activities

Authors:
Holger Junker;Oliver Amft;Paul Lukowicz;Gerhard Tröster
Affiliations:
Wearable Computing Lab., ETH Zurich, Gloriastrasse 35, 8092 Zurich, Switzerland;Wearable Computing Lab., ETH Zurich, Gloriastrasse 35, 8092 Zurich, Switzerland;Embedded Systems Group, University of Passau, Innstrasse 43, 94032 Passau, Germany;Wearable Computing Lab., ETH Zurich, Gloriastrasse 35, 8092 Zurich, Switzerland
Venue:
Pattern Recognition
Year:
2008

Citing 19
Cited 26

An HMM-Based Threshold Model Approach for Gesture Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
A survey of computer vision-based human motion capture

Computer Vision and Image Understanding - Modeling people toward vision-based underatanding of a person's shape, appearance, and movement
Motion-Based Recognition

Motion-Based Recognition
An Online Algorithm for Segmenting Time Series

ICDM '01 Proceedings of the 2001 IEEE International Conference on Data Mining
Vision-Based Gesture Recognition: A Review

GW '99 Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction
Unsupervised Analysis of Human Gestures

PCM '01 Proceedings of the Second IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
Coupled hidden Markov models for complex action recognition

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
A Real-Time Continuous Gesture Recognition System for Sign Language

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Recognition of human body motion using phase space constraints

ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
An HMM-Based Approach for Gesture Segmentation and Recognition

ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 3
Using Multiple Sensors for Mobile Sign Language Recognition

ISWC '03 Proceedings of the 7th IEEE International Symposium on Wearable Computers
SoundButton: Design of a Low Power Wearable Audio Classification System

ISWC '03 Proceedings of the 7th IEEE International Symposium on Wearable Computers
Fine-Grained Activity Recognition by Aggregating Abstract Object Usage

ISWC '05 Proceedings of the Ninth IEEE International Symposium on Wearable Computers
Using Ultrasonic Hand Tracking to Augment Motion Analysis Based Recognition of Manipulative Gestures

ISWC '05 Proceedings of the Ninth IEEE International Symposium on Wearable Computers
Detection of eating and drinking arm gestures using inertial body-worn sensors

ISWC '05 Proceedings of the Ninth IEEE International Symposium on Wearable Computers
Gesture spotting using wrist worn microphone and 3-axis accelerometer

Proceedings of the 2005 joint conference on Smart objects and ambient intelligence: innovative context-aware services: usages and technologies
Documenting Motion Sequences with a Personalized Annotation System

IEEE MultiMedia
Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers

IEEE Transactions on Pattern Analysis and Machine Intelligence
Analysis of chewing sounds for dietary monitoring

UbiComp'05 Proceedings of the 7th international conference on Ubiquitous Computing

Gesture-Controlled User Input to Complete Questionnaires on Wrist-Worn Watches

Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
Recognizing short duration hand movements from accelerometer data

ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Online hand gesture recognition using neural network based segmentation

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
Recognition of hand movements using wearable accelerometers

Journal of Ambient Intelligence and Smart Environments
Comparative study on classifying human activities with miniature inertial and magnetic sensors

Pattern Recognition
Detecting activities from body-worn accelerometers via instance-based algorithms

Pervasive and Mobile Computing
On the use of magnetic field disturbances as features for activity recognition with on body sensors

EuroSSC'10 Proceedings of the 5th European conference on Smart sensing and context
A dynamic sliding window approach for activity recognition

UMAP'11 Proceedings of the 19th international conference on User modeling, adaption, and personalization
Incorporating motion data and cognitive models in IPS2

ICDHM'11 Proceedings of the Third international conference on Digital human modeling
Recognizing multiple human activities and tracking full-body pose in unconstrained environments

Pattern Recognition
E-Gesture: a collaborative architecture for energy-efficient gesture recognition with hand-worn sensor and mobile devices

Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems
Designing gestures for hands and feet in daily life

Proceedings of the 9th International Conference on Advances in Mobile Computing and Multimedia
Tool use as gesture: new challenges for maintenance and rehabilitation

BCS '10 Proceedings of the 24th BCS Interaction Specialist Group Conference
Semantic management of multiple contexts in a pervasive computing framework

Expert Systems with Applications: An International Journal
Recognition of hand movements using wearable accelerometers

Journal of Ambient Intelligence and Smart Environments
An integrated framework for human activity classification

Proceedings of the 2012 ACM Conference on Ubiquitous Computing
Continuous classification of spatio-temporal data streams using liquid state machines

ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part IV
SAPHE: simple accelerometer based wireless pairing with heuristic trees

Proceedings of the 10th International Conference on Advances in Mobile Computing & Multimedia
Compressed signal representation for inertial sensor signals

Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication
Touch-less interaction with medical images using hand & foot gestures

Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication
A smart watch-based gesture recognition system for assisting people with visual impairments

Proceedings of the 3rd ACM international workshop on Interactive multimedia on mobile & portable devices
A Study of Temporal Action Sequencing During Consumption of a Meal

Proceedings of the International Conference on Bioinformatics, Computational Biology and Biomedical Informatics
A multi-modal gesture recognition system using audio, video, and skeletal joint data

Proceedings of the 15th ACM on International conference on multimodal interaction
Context-based hand gesture recognition for the operating room

Pattern Recognition Letters
Activity recognition on streaming sensor data

Pervasive and Mobile Computing
Airwriting: a wearable handwriting recognition system

Personal and Ubiquitous Computing

Quantified Score

Hi-index	0.01

Visualization

Abstract

We present a method for spotting sporadically occurring gestures in a continuous data stream from body-worn inertial sensors. Our method is based on a natural partitioning of continuous sensor signals and uses a two-stage approach for the spotting task. In a first stage, signal sections likely to contain specific motion events are preselected using a simple similarity search. Those preselected sections are then further classified in a second stage, exploiting the recognition capabilities of hidden Markov models. Based on two case studies, we discuss implementation details of our approach and show that it is a feasible strategy for the spotting of various types of motion events.