Knowledge-based augmented reality
Communications of the ACM - Special issue on computer augmented environments: back to the real world
Decision Combination in Multiple Classifier Systems
IEEE Transactions on Pattern Analysis and Machine Intelligence
An Experimental Comparison of Range Image Segmentation Algorithms
IEEE Transactions on Pattern Analysis and Machine Intelligence
IEEE Transactions on Pattern Analysis and Machine Intelligence
Empirical Performance Evaluation of Graphics Recognition Systems
IEEE Transactions on Pattern Analysis and Machine Intelligence
Information Retrieval
Proactive Instructions for Furniture Assembly
UbiComp '02 Proceedings of the 4th international conference on Ubiquitous Computing
Learning visual behavior for gesture analysis
ISCV '95 Proceedings of the International Symposium on Computer Vision
Context Awareness by Analyzing Accelerometer Data
ISWC '00 Proceedings of the 4th IEEE International Symposium on Wearable Computers
What Shall We Teach Our Pants?
ISWC '00 Proceedings of the 4th IEEE International Symposium on Wearable Computers
Visual Contextual Awareness in Wearable Computing
ISWC '98 Proceedings of the 2nd IEEE International Symposium on Wearable Computers
DigitEyes: Vision-Based Human Hand Tracking
DigitEyes: Vision-Based Human Hand Tracking
Wearable Sensing to Annotate Meeting Recordings
ISWC '02 Proceedings of the 6th IEEE International Symposium on Wearable Computers
ASL Recognition Based on a Coupling Between HMMs and 3D Motion Analysis
ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Using Multiple Sensors for Mobile Sign Language Recognition
ISWC '03 Proceedings of the 7th IEEE International Symposium on Wearable Computers
SoundButton: Design of a Low Power Wearable Audio Classification System
ISWC '03 Proceedings of the 7th IEEE International Symposium on Wearable Computers
Pattern Classification (2nd Edition)
Pattern Classification (2nd Edition)
Large vocabulary sign language recognition based on hierarchical decision trees
Proceedings of the 5th international conference on Multimodal interfaces
A Ubiquitous Computing environment for aircraft maintenance
Proceedings of the 2004 ACM symposium on Applied computing
Implementation and Evaluation of a Low-Power Sound-Based User Activity Recognition System
ISWC '04 Proceedings of the Eighth International Symposium on Wearable Computers
Continuous Recognition of Arm Activities With Body-Worn Inertial Sensors
ISWC '04 Proceedings of the Eighth International Symposium on Wearable Computers
Computer Animation and Virtual Worlds
Using Ultrasonic Hand Tracking to Augment Motion Analysis Based Recognition of Manipulative Gestures
ISWC '05 Proceedings of the Ninth IEEE International Symposium on Wearable Computers
Detection of eating and drinking arm gestures using inertial body-worn sensors
ISWC '05 Proceedings of the Ninth IEEE International Symposium on Wearable Computers
Gesture spotting using wrist worn microphone and 3-axis accelerometer
Proceedings of the 2005 joint conference on Smart objects and ambient intelligence: innovative context-aware services: usages and technologies
WearIT@work: Toward Real-World Industrial Wearable Computing
IEEE Pervasive Computing
Engineering contextual knowledge for autonomic pervasive services
Information and Software Technology
Recognition of dietary activity events using on-body sensors
Artificial Intelligence in Medicine
Gesture spotting with body-worn inertial sensors to detect user activities
Pattern Recognition
Multi-signal extension of adaptive frequency tracking algorithms
Signal Processing
Office activity recognition using hand posture cues
BCS-HCI '08 Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction - Volume 2
Robust Recognition of Reading Activity in Transit Using Wearable Electrooculography
Pervasive '08 Proceedings of the 6th International Conference on Pervasive Computing
Multi Activity Recognition Based on Bodymodel-Derived Primitives
LoCA '09 Proceedings of the 4th International Symposium on Location and Context Awareness
Activity Inference through Sequence Alignment
LoCA '09 Proceedings of the 4th International Symposium on Location and Context Awareness
Distributed Continuous Action Recognition Using a Hidden Markov Model in Body Sensor Networks
DCOSS '09 Proceedings of the 5th IEEE International Conference on Distributed Computing in Sensor Systems
A Context-Aware AR Navigation System Using Wearable Sensors
Proceedings of the 13th International Conference on Human-Computer Interaction. Part III: Ubiquitous and Intelligent Interaction
Recognizing daily activities with RFID-based sensors
Proceedings of the 11th international conference on Ubiquitous computing
A flexible sequence alignment approach on pattern mining and matching for human activity recognition
Expert Systems with Applications: An International Journal
A method for analyzing work tasks and status by video-and-PC-monitoring system
AMC '09 Proceedings of the 2009 workshop on Ambient media computing
Context-aware middleware for pervasive elderly homecare
IEEE Journal on Selected Areas in Communications - Special issue on wireless and pervasive communications for healthcare
An automatic segmentation technique in body sensor networks based on signal energy
BodyNets '09 Proceedings of the Fourth International Conference on Body Area Networks
Recognizing short duration hand movements from accelerometer data
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Distributed activity recognition using key sensors
ICACT'09 Proceedings of the 11th international conference on Advanced Communication Technology - Volume 3
Object relevance weight pattern mining for activity recognition and segmentation
Pervasive and Mobile Computing
Recognition of hand movements using wearable accelerometers
Journal of Ambient Intelligence and Smart Environments
An unsupervised approach to activity recognition and segmentation based on object-use fingerprints
Data & Knowledge Engineering
A task-driven intelligent workspace system to provide guidance feedback
Computer Vision and Image Understanding
Discriminative temporal smoothing for activity recognition from wearable sensors
UCS'07 Proceedings of the 4th international conference on Ubiquitous computing systems
Activity recognition based on intra and extra manipulation of everyday objects
UCS'07 Proceedings of the 4th international conference on Ubiquitous computing systems
Derivations of normalized mutual information in binary classifications
FSKD'09 Proceedings of the 6th international conference on Fuzzy systems and knowledge discovery - Volume 1
Bringing quality of context into wearable human activity recognition systems
QuaCon'09 Proceedings of the 1st international conference on Quality of context
Challenges in ubiquitous context recognition with personal mobile devices
Proceedings of the 4th ACM International Workshop on Context-Awareness for Self-Managing Systems
Combining inertial and visual sensing for human action recognition in tennis
Proceedings of the first ACM international workshop on Analysis and retrieval of tracked events and motion in imagery streams
Performance metrics for activity recognition
ACM Transactions on Intelligent Systems and Technology (TIST)
Object interaction detection using hand posture cues in an office setting
International Journal of Human-Computer Studies
Vision-based hand-gesture applications
Communications of the ACM
Child-activity recognition from multi-sensor data
Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research
EURASIP Journal on Wireless Communications and Networking - Special issue on towards the connected body: advances in body communications
Recognizing multi-user activities using wearable sensors in a smart home
Pervasive and Mobile Computing
Building a real-world body area sensor network system
Proceedings of the Second Asia-Pacific Symposium on Internetware
Improving the classification accuracy of streaming data using SAX similarity features
Pattern Recognition Letters
Semi-Markov conditional random fields for accelerometer-based activity recognition
Applied Intelligence
ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Multimodal segmentation of object manipulation sequences with product models
ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
COGNITO: a cognitive assistance and training system for manual tasks in industry
Proceedings of the 29th Annual European Conference on Cognitive Ergonomics
Simple and robust BSN-based activity classification: winning the first BSN contest
Proceedings of the 4th International Symposium on Applied Sciences in Biomedical and Communication Technologies
Multimodal recognition of reading activity in transit using body-worn sensors
ACM Transactions on Applied Perception (TAP)
Unsupervised learning in body-area networks
Proceedings of the Fifth International Conference on Body Area Networks
Automatic Segmentation and Recognition in Body Sensor Networks Using a Hidden Markov Model
ACM Transactions on Embedded Computing Systems (TECS) - Special Section on CAPA'09, Special Section on WHS'09, and Special Section VCPSS' 09
ACM Transactions on Embedded Computing Systems (TECS)
Recognition of hand movements using wearable accelerometers
Journal of Ambient Intelligence and Smart Environments
Environmental sound recognition by measuring significant changes in the spectral entropy
MCPR'12 Proceedings of the 4th Mexican conference on Pattern Recognition
ICEC'07 Proceedings of the 6th international conference on Entertainment Computing
A probability model for recognition of dynamic gesture based on a finger-worn device
AMT'12 Proceedings of the 8th international conference on Active Media Technology
Egocentric activity monitoring and recovery
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
Complex activity recognition using context-driven activity theory and activity signatures
ACM Transactions on Computer-Human Interaction (TOCHI)
ClimbAX: skill assessment for climbing enthusiasts
Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
Ultrasound-based movement sensing, gesture-, and context-recognition
Proceedings of the 2013 International Symposium on Wearable Computers
A tutorial on human activity recognition using body-worn inertial sensors
ACM Computing Surveys (CSUR)
ISNN'13 Proceedings of the 10th international conference on Advances in Neural Networks - Volume Part II
Affective and cognitive design for mass personalization: status and prospect
Journal of Intelligent Manufacturing
The Journal of Supercomputing
Hi-index | 0.16 |
In order to provide relevant information to mobile users, such as workers engaging in the manual tasks of maintenance and assembly, a wearable computer requires information about the user's specific activities. This work focuses on the recognition of activities that are characterized by a hand motion and an accompanying sound. Suitable activities can be found in assembly and maintenance work. Here, we provide an initial exploration into the problem domain of continuous activity recognition using on-body sensing. We use a mock "wood workshop” assembly task to ground our investigation. We describe a method for the continuous recognition of activities (sawing, hammering, filing, drilling, grinding, sanding, opening a drawer, tightening a vise, and turning a screwdriver) using microphones and three-axis accelerometers mounted at two positions on the user's arms. Potentially "interesting” activities are segmented from continuous streams of data using an analysis of the sound intensity detected at the two different locations. Activity classification is then performed on these detected segments using linear discriminant analysis (LDA) on the sound channel and hidden Markov models (HMMs) on the acceleration data. Four different methods at classifier fusion are compared for improving these classifications. Using user-dependent training, we obtain continuous average recall and precision rates (for positive activities) of 78 percent and 74 percent, respectively. Using user-independent training (leave-one-out across five users), we obtain recall rates of 66 percent and precision rates of 63 percent. In isolation, these activities were recognized with accuracies of 98 percent, 87 percent, and 95 percent for the user-dependent, user-independent, and user-adapted cases, respectively.