Deciphering visual gist and its implications for video retrieval and interface design

Authors:
Meng Yang;Gary Marchionini
Affiliations:
University of North Carolina at Chapel Hill, Chapel Hill, NC;University of North Carolina at Chapel Hill, Chapel Hill, NC
Venue:
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Year:
2005

Citing 6
Cited 4

Salient stills: process and practice

IBM Systems Journal
Attributes of images in describing tasks

Information Processing and Management: an International Journal
Key to effective video retrieval: effective cataloging and browsing

MULTIMEDIA '98 Proceedings of the sixth ACM international conference on Multimedia
Multimodal surrogates for video browsing

Proceedings of the fourth ACM conference on Digital libraries
Alternative Surrogates for Video Objects in a Digital Library: Users' Perspectives on Their Relative Usability

ECDL '02 Proceedings of the 6th European Conference on Research and Advanced Technology for Digital Libraries
How fast is too fast?: evaluating fast forward surrogates for digital video

Proceedings of the 3rd ACM/IEEE-CS joint conference on Digital libraries

Effects of audio and visual surrogates for making sense of digital video

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
How people find videos

Proceedings of the 8th ACM/IEEE-CS joint conference on Digital libraries
Keyframe-less integration of semantic information in a video player interface

Proceedings of the seventh european conference on European interactive television conference
Evaluation constructs for visual video summaries

ECDL'10 Proceedings of the 14th European conference on Research and advanced technology for digital libraries

Quantified Score

Hi-index	0.00

Visualization

Abstract

How do people make sense of a video based on viewing a few frames of that video? What elements constitute the "visual gist" in their minds? Answers to these questions will give implications to both content-based video retrieval and the interface design (e.g., key-frame selection) of digital video libraries. A preliminary study was conducted to unravel the issues and 45 subjects participated in the study. After viewing a fast forward surrogate, the subjects were asked to choose pictures which they thought would "belong to" the video. And they were also asked to think aloud during their selection processes. Nine visual gist attributes (e.g., people, objects and actions) were generated using the grounded theory method and their frequencies were also compared and analyzed.