User performance with gaze contingent multiresolutional displays
ETRA '00 Proceedings of the 2000 symposium on Eye tracking research & applications
Rate scalable video coding using a foveation-based human visual system model
ICASSP '01 Proceedings of the Acoustics, Speech, and Signal Processing, 2001. on IEEE International Conference - Volume 03
Acuity-matching resolution degradation through wavelet coefficient scaling
IEEE Transactions on Image Processing
Foveated video compression with optimal rate control
IEEE Transactions on Image Processing
Perceptual media compression for multiple viewers with feedback delay
Proceedings of the 13th annual ACM international conference on Multimedia
Proceedings of the 2006 symposium on Eye tracking research & applications
How late can you update gaze-contingent multiresolutional displays without detection?
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Predictive real-time perceptual compression based on eye-gaze-position analysis
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Fast perceptual region tracking with coding-depth sensitive access for stream transcoding
Journal of Visual Communication and Image Representation
On spatiochromatic visual sensitivity and peripheral color LOD management
ACM Transactions on Applied Perception (TAP)
Video SnapCut: robust video object cutout using localized classifiers
ACM SIGGRAPH 2009 papers
| Hi-index | 0.00 |
Approximately 2 degrees in our 140 degree vision span has sharp vision. Many researchers have been fascinated by the idea of eye-tracking integrated perceptual compression of an image or video, yet any practical system has yet to emerge. The unique challenge presented by real time perceptual video streaming is how to handle the fast nature of the human eye and provide its integration with computationally intensive video transcoding scheme. The delay introduced by video transmission in the network presents a difficulty. This delay creates a problem when we try to use information about eye movements for perceptual encoding. In this paper we discuss a new approach to the eye-tracker based video compression. Rather than relying on the point of gaze, this novel scheme tracks a vicinity of interest and offers a prediction mechanism for eye movements. The described system compensates the interim eye movements between the sampling and actual coding. The proposed scheme can be applied to a large variety of today's video compression standards. We have developed an eye gaze-aware MPEG-2 transcoder that can perceptually re-encode a live video stream in real time. The experiments we have conducted illustrate the substantial impact this integrated prediction method has on perceptual video compression and bit-rate reduction.