Retrieval of time-varying mesh and motion capture data using 2D video queries based on silhouette shape descriptors

Authors:
Daisuke Kasai;Toshihiko Yamasaki;Kiyoharu Aizawa
Affiliations:
Department of Information and Communication Engineering, The University of Tokyo;Department of Information and Communication Engineering, The University of Tokyo and MSR IJARC Fellow;Department of Information and Communication Engineering, The University of Tokyo
Venue:
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Year:
2009

Citing 8
Cited 4

Fast Approximate Energy Minimization via Graph Cuts

IEEE Transactions on Pattern Analysis and Machine Intelligence
Shape distributions

ACM Transactions on Graphics (TOG)
Virtualized Reality: Constructing Virtual Worlds from Real Scenes

IEEE MultiMedia
Efficient content-based retrieval of motion capture data

ACM SIGGRAPH 2005 Papers
Motion segmentation and retrieval for 3D video based on modified shape distribution

EURASIP Journal on Applied Signal Processing
Performance capture from sparse multi-view video

ACM SIGGRAPH 2008 papers
Content-based retrieval for human motion data

Journal of Visual Communication and Image Representation
Real-time dynamic 3-D object shape reconstruction and high-fidelity texture mapping for 3-D video

IEEE Transactions on Circuits and Systems for Video Technology

A euclidean-geodesic shape distribution for retrieval of time-varying mesh sequences

ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Motion Sequence-Based Human Abnormality Detection Scheme for Smart Spaces

Wireless Personal Communications: An International Journal
Pedestrian attribute analysis using a top-view camera in a public space

MMM'12 Proceedings of the 18th international conference on Advances in Multimedia Modeling
Hierarchical querying scheme of human motions for smart home environment

Engineering Applications of Artificial Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a retrieval system for Time-Varying Mesh (TVM) and motion capture data using 2D video queries. Previous approaches have used other TVM and motion capture data as queries and the cost for query generation was a significant issue. Instead, the proposed system uses 2D video queries, which can be easily captured by a single camera, enabling end users to retrieve 3D motion sequences such as TVM and motion capture data easily and interactively. We introduce the P-type Fourier descriptor, which is a feature of 2D contour images. TVM and computer graphics sequences rendered from motion capture data are silhouetted rendering from multiple viewpoints. Feature vectors for TVM and motion capture data are generated by applying the P-type Fourier descriptor to these silhouetted images. Experimental results using four TVM sequences and motion capture data demonstrated an average retrieval accuracy of 88% in terms of nearest neighbors.