IMPACT: an interactive natural-motion-picture dedicated multimedia authoring system
CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Automatic partitioning of full-motion video
Multimedia Systems
Sit straight (and tell me what I did today): a human posture alarm and activity summarization system
CARPE '05 Proceedings of the 2nd ACM workshop on Continuous archival and retrieval of personal experiences
Proceedings of the 11th international conference on Intelligent user interfaces
A vision-based attentive user interface with (semi-)automatic parameter calibration
CompSysTech '09 Proceedings of the International Conference on Computer Systems and Technologies and Workshop for PhD Students in Computing
Hi-index | 0.00 |
In this paper, we describe a novel classification technique that separates video scenes, like office work tasks, into several scenes according to each task. Even if the difference of as a whole image frame by frame in each task is small, the difference of worker's movement is quite big due to the position of face and hands according to each task. In addition, the worker has the tendency to turn his/her face to look at the particular objects of individual tasks like PC, a document, and so on. Then, we decide to separate tasks based on face position, face angle in depth, and hand positions. For comparison of frames in a video, we use the Maharanobis distance to measure the difference of multivariate data that consist of face coordinates, face angle in depth, and coordinates of both hands. For the separation of tasks by the Maharanobis distance of an each frame, we use the hierarchical clustering method to classify frames in a video according to each task. For the robust detection of both hands, we use color-based method that searches hand areas using face color. Although the color of hands changes corresponding to the lighting conditions, the color of hands should be very similar to that of the face in an office. Therefore, even when the lighting condition changes, our color-based hand detection method does not need any adjustment to the change. We apply this classification technique to separate office work video into individual sets of task scenes. As a result, our technique shows better task separation performance than the histogram-based boundary detection technique.