An Experimental Comparison of Range Image Segmentation Algorithms
IEEE Transactions on Pattern Analysis and Machine Intelligence
Information Retrieval
The Case against Accuracy Estimation for Comparing Induction Algorithms
ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Fast Similarity Search in the Presence of Noise, Scaling, and Translation in Time-Series Databases
VLDB '95 Proceedings of the 21th International Conference on Very Large Data Bases
Landmarks: A New Model for Similarity-Based Pattern Querying in Time Series Databases
ICDE '00 Proceedings of the 16th International Conference on Data Engineering
Fine-Grained Activity Recognition by Aggregating Abstract Object Usage
ISWC '05 Proceedings of the Ninth IEEE International Symposium on Wearable Computers
Recognizing Mimicked Autistic Self-Stimulatory Behaviors Using HMMs
ISWC '05 Proceedings of the Ninth IEEE International Symposium on Wearable Computers
Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers
IEEE Transactions on Pattern Analysis and Machine Intelligence
Sensing from the basement: a feasibility study of unobtrusive and low-cost home activity recognition
UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Performance Evaluation and Benchmarking of Six-Page Segmentation Algorithms
IEEE Transactions on Pattern Analysis and Machine Intelligence
Discovery of activity patterns using topic models
UbiComp '08 Proceedings of the 10th international conference on Ubiquitous computing
TRAcME: Temporal Activity Recognition Using Mobile Phone Data
EUC '08 Proceedings of the 2008 IEEE/IFIP International Conference on Embedded and Ubiquitous Computing - Volume 01
IEEE Transactions on Pattern Analysis and Machine Intelligence
Robust Recognition of Reading Activity in Transit Using Wearable Electrooculography
Pervasive '08 Proceedings of the 6th International Conference on Pervasive Computing
Multi Activity Recognition Based on Bodymodel-Derived Primitives
LoCA '09 Proceedings of the 4th International Symposium on Location and Context Awareness
Recognizing daily activities with RFID-based sensors
Proceedings of the 11th international conference on Ubiquitous computing
Proceedings of the 11th international conference on Ubiquitous computing
AUC: a statistically consistent and more discriminating measure than accuracy
IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
A hybrid discriminative/generative approach for modeling human activities
IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
A long-term evaluation of sensing modalities for activity recognition
UbiComp '07 Proceedings of the 9th international conference on Ubiquitous computing
Scalable recognition of daily activities with wearable sensors
LoCA'07 Proceedings of the 3rd international conference on Location-and context-awareness
Evaluating performance in continuous context recognition using event-driven error characterisation
LoCA'06 Proceedings of the Second international conference on Location- and Context-Awareness
Using a live-in laboratory for ubiquitous computing research
PERVASIVE'06 Proceedings of the 4th international conference on Pervasive Computing
Object-based activity recognition with heterogeneous sensors on wrist
Pervasive'10 Proceedings of the 8th international conference on Pervasive Computing
Transferring knowledge of activity recognition across sensor networks
Pervasive'10 Proceedings of the 8th international conference on Pervasive Computing
Generic performance metrics for continuous activity recognition
KI'11 Proceedings of the 34th Annual German conference on Advances in artificial intelligence
Multimodal recognition of reading activity in transit using body-worn sensors
ACM Transactions on Applied Perception (TAP)
Estimation algorithm of machine operational intention by bayes filtering with self-organizing map
Advances in Human-Computer Interaction
Cross-people mobile-phone based activity recognition
IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Three
Proceedings of the 2012 ACM Conference on Ubiquitous Computing
Team activity recognition in sports
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VII
Creating and benchmarking a new dataset for physical activity monitoring
Proceedings of the 5th International Conference on PErvasive Technologies Related to Assistive Environments
Confidence-based multiclass AdaBoost for physical activity monitoring
Proceedings of the 2013 International Symposium on Wearable Computers
A tutorial on human activity recognition using body-worn inertial sensors
ACM Computing Surveys (CSUR)
Accelerometer-based transportation mode detection on smartphones
Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems
Activity recognition based on a multi-sensor meta-classifier
IWANN'13 Proceedings of the 12th international conference on Artificial Neural Networks: advences in computational intelligence - Volume Part II
Real-time fall detection and activity recognition using low-cost wearable sensors
ICCSA'13 Proceedings of the 13th international conference on Computational Science and Its Applications - Volume 1
ChAirGest: a challenge for multimodal mid-air gesture recognition for close HCI
Proceedings of the 15th ACM on International conference on multimodal interaction
Towards robust activity recognition for everyday life: methods and evaluation
Proceedings of the 7th International Conference on Pervasive Computing Technologies for Healthcare
The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition
Pattern Recognition Letters
A wearable sensor based approach to real-time fall detection and fine-grained activity recognition
Journal of Mobile Multimedia
Hi-index | 0.00 |
In this article, we introduce and evaluate a comprehensive set of performance metrics and visualisations for continuous activity recognition (AR). We demonstrate how standard evaluation methods, often borrowed from related pattern recognition problems, fail to capture common artefacts found in continuous AR—specifically event fragmentation, event merging and timing offsets. We support our assertion with an analysis on a set of recently published AR papers. Building on an earlier initial work on the topic, we develop a frame-based visualisation and corresponding set of class-skew invariant metrics for the one class versus all evaluation. These are complemented by a new complete set of event-based metrics that allow a quick graphical representation of system performance—showing events that are correct, inserted, deleted, fragmented, merged and those which are both fragmented and merged. We evaluate the utility of our approach through comparison with standard metrics on data from three different published experiments. This shows that where event- and frame-based precision and recall lead to an ambiguous interpretation of results in some cases, the proposed metrics provide a consistently unambiguous explanation.