Human action annotation, modeling and analysis based on implicit user interaction

Authors:
Klimis S. Ntalianis;Anastasios D. Doulamis;Nicolas Tsapatsoulis;Nikolaos Doulamis
Affiliations:
Electrical and Computer Engineering Department, National Technical University of Athens, Athens, Greece 15773;Department of Production Engineering and Management, Technical University of Crete, Chania, Greece 73100;Department of Communication and Internet Studies, Cyprus University of Technology, Limassol, Cyprus 3603;Electrical and Computer Engineering Department, National Technical University of Athens, Athens, Greece 15773
Venue:
Multimedia Tools and Applications
Year:
2010

Citing 25
Cited 5

Adaptive filter theory (3rd ed.)

Adaptive filter theory (3rd ed.)
Real life, real users, and real needs: a study and analysis of user queries on the web

Information Processing and Management: an International Journal
A Multilinear Singular Value Decomposition

SIAM Journal on Matrix Analysis and Applications
Content-Based Image Retrieval at the End of the Early Years

IEEE Transactions on Pattern Analysis and Machine Intelligence
Unsupervised Segmentation of Color-Texture Regions in Images and Video

IEEE Transactions on Pattern Analysis and Machine Intelligence
Neural Networks: A Comprehensive Foundation

Neural Networks: A Comprehensive Foundation
Semantic Annotation of Sports Videos

IEEE MultiMedia
Analysis of the Clustering Properties of the Hilbert Space-Filling Curve

IEEE Transactions on Knowledge and Data Engineering
Optimizing search engines using clickthrough data

Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
TensorTextures: multilinear image-based rendering

ACM SIGGRAPH 2004 Papers
Recognizing Human Actions: A Local SVM Approach

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3 - Volume 03
Bridge Ontology and Its Role in Semantic Annotation

CW '04 Proceedings of the 2004 International Conference on Cyberworlds
ViVo: Visual Vocabulary Construction for Mining Biomedical Images

ICDM '05 Proceedings of the Fifth IEEE International Conference on Data Mining
The Story Picturing Engine---a system for automatic text illustration

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Algorithm 862: MATLAB tensor classes for fast algorithm prototyping

ACM Transactions on Mathematical Software (TOMS)
Using Multimedia Ontology for Generating Conceptual Annotations and Hyperlinks in Video Collections

WI '06 Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence
Semantic annotation and retrieval of video events using multimedia ontologies

ICSC '07 Proceedings of the International Conference on Semantic Computing
Classifying Images from Athletics Based on Spatial Relations

SMAP '07 Proceedings of the Second International Workshop on Semantic Media Adaptation and Personalization
Real-Time Computerized Annotation of Pictures

IEEE Transactions on Pattern Analysis and Machine Intelligence
Scalable Tensor Decompositions for Multi-aspect Data Mining

ICDM '08 Proceedings of the 2008 Eighth IEEE International Conference on Data Mining
Incorporating Concept Ontology for Hierarchical Video Classification, Annotation, and Visualization

IEEE Transactions on Multimedia
Integrated Mining of Visual Features, Speech Features, and Frequent Patterns for Semantic Video Annotation

IEEE Transactions on Multimedia
Non-sequential video content representation using temporal variation of feature vectors

IEEE Transactions on Consumer Electronics
Integrating Concept Ontology and Multitask Learning to Achieve More Effective Classifier Training for Multilevel Image Annotation

IEEE Transactions on Image Processing
On-line retrainable neural networks: improving the performance of neural networks in image analysis problems

IEEE Transactions on Neural Networks

Automatic authoring of interactive multimedia documents via media-oriented operators

ACM SIGAPP Applied Computing Review
Robust human action recognition scheme based on high-level feature fusion

Multimedia Tools and Applications
VideoSkip: event detection in social web videos with an implicit user heuristic

Multimedia Tools and Applications
Automatic annotation of image databases based on implicit crowdsourcing, visual concept modeling and evolution

Multimedia Tools and Applications
Using contextual spaces for image re-ranking and rank aggregation

Multimedia Tools and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper proposes an integrated framework for analyzing human actions in video streams. Despite most current approaches that are just based on automatic spatiotemporal analysis of sequences, the proposed method introduces the implicit user-in-the-loop concept for dynamically mining semantics and annotating video streams. This work sets a new and ambitious goal: to recognize, model and properly use "average user's" selections, preferences and perception, for dynamically extracting content semantics. The proposed approach is expected to add significant value to hundreds of billions of non-annotated or inadequately annotated video streams existing in the Web, file servers, databases etc. Furthermore expert annotators can gain important knowledge relevant to user preferences, selections, styles of searching and perception.