Multimedia integration for cooking video indexing

Authors:
Reiko Hamada;Koichi Miura;Ichiro Ide;Shin'ichi Satoh;Shuichi Sakai;Hidehiko Tanaka
Affiliations:
The University of Tokyo, Tokyo, Japan;The University of Tokyo, Tokyo, Japan;Nagoya University, Nagoya, Japan;National Institute of Informatics, Tokyo, Japan;The University of Tokyo, Tokyo, Japan;Institute of Information and Security, Yokohama, Japan
Venue:
PCM'04 Proceedings of the 5th Pacific Rim Conference on Advances in Multimedia Information Processing - Volume Part II
Year:
2004

Citing 2
Cited 4

Complementary video and audio analysis for broadcast news archives

Communications of the ACM
Structural analysis of cooking preparation steps in Japanese

IRAL '00 Proceedings of the fifth international workshop on on Information retrieval with Asian languages

Cooking navi: assistant for daily cooking in kitchen

Proceedings of the 13th annual ACM international conference on Multimedia
Virtual assistant: an artificial agent for enhancing content acquisition: how ambient media elicit information from humans

SAME '08 Proceedings of the 1st ACM international workshop on Semantic ambient media experiences
Virtual assistant: enhancing content acquisition by eliciting information from humans

Multimedia Tools and Applications
Video cooking: towards the synthesis of multimedia cooking recipes

MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

We have been working on the integration of video with supplementary documents, such as cooking programs. We propose an integration system that performs semantic segmentations of video and text and associates them together. This association is realized using the ordinal restriction of the recipe, cooccurrences of words in the text and the audio in the video, and the relation between the background in a video and words which describe the situation in a text. In this paper, we will introduce the result of an evaluation experiment and show the effectiveness of the proposed integration method. Through our method, many applications should become possible, such as a cooking navigation software.