Compensating for low frame rates

Authors:
Hendrik Knoche;Hermann de Meer;David Kirsh
Affiliations:
University College London, London, UK;University of Passau, Passau, Germany;University of California, San Diego, La Jolla, CA
Venue:
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Year:
2005

Citing 2
Cited 2

Frame rate as a QoS parameter and its influence on speech perception

Multimedia Systems
Human perception of jitter and media synchronization

IEEE Journal on Selected Areas in Communications

How bad is good enough?: exploring mobile video quality trade-offs for bandwidth-constrained consumers

Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design
Audio-visual speech understanding in simulated telephony applications by individuals with hearing loss

Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility

Quantified Score

Hi-index	0.00

Visualization

Abstract

Experiments were conducted to investigate the interdependency of frame rates (30, 15, 10 fps) and audio-visual skew (from +163 to -233 ms1). Noised nonsense words like 'abagava' were presented to 20 participants who were asked to identify the middle consonant. At low frame rates (10 fps) consonant perception was impaired when audio ran ahead of video content (skew of ?113 to ?233ms). When audio lagged video, performance improved monotonically to a maximum at +167ms, where performance equaled 30fps in synch. The results suggest that frame rate and skew are not orthogonal parameters but must both be taken into consideration for AV-delivery. The findings do not support the current notion that 10 fps videos do not adequately capture visual content for speech perception. Participants were able to integrate the given bi-modal information as well as the 30 fps condition if the audio channel was subjected to an additional 167ms delay.