Exploiting self-adaptive posture-based focus estimation for lecture video editing

Authors:
Feng Wang;Chong-Wah Ngo;Ting-Chuen Pong
Affiliations:
Hong Kong University of Science and Technology;City University of Hong Kong;Hong Kong University of Science and Technology
Venue:
Proceedings of the 13th annual ACM international conference on Multimedia
Year:
2005

Citing 4
Cited 0

Face Detection in Color Images

IEEE Transactions on Pattern Analysis and Machine Intelligence
Videography for telepresentations

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Shooting the Lecture Scene Using Computer-controlled Cameras Based on Situation Understanding and Evaluation of Video Images

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 1 - Volume 01
Gesture Tracking and Recognition for Lecture Video Editing

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3 - Volume 03

Quantified Score

Hi-index	0.00

Visualization

Abstract

Head pose plays a special role in estimating a presenter's focuses and actions for lecture video editing. This paper presents an efficient and robust head pose estimation algorithm to cope with the new challenges arising in the content management of lecture videos. These challenges include speed requirement, low video quality, variant presenting styles and complex settings in modern classrooms. Our algorithm is based on a robust hierarchical representation of skin color clustering and a set of pose templates that are automatically trained. Contextual information is also considered to refine pose estimation. Most importantly, we propose an online learning approach to deal with different presenting styles, which has not been addressed before. We show that the proposed approach can significantly improve the performance of pose estimation. In addition, we also describe how posture is used in focus estimation for lecture video editing by integrating with gesture.