Towards virtual videography (poster session)
MULTIMEDIA '00 Proceedings of the eighth ACM international conference on Multimedia
Multiple view geometry in computer visiond
Multiple view geometry in computer visiond
Automatic pan control system for broadcasting ball games based on audience's face direction
Proceedings of the 12th annual ACM international conference on Multimedia
Virtual Forces for Camera Planning in Smart Vision Systems
WACV-MOTION '05 Proceedings of the Seventh IEEE Workshops on Application of Computer Vision (WACV/MOTION'05) - Volume 1 - Volume 01
ISM '06 Proceedings of the Eighth IEEE International Symposium on Multimedia
Re-cinematography: improving the camera dynamics of casual video
Proceedings of the 15th international conference on Multimedia
An automated end-to-end lecture capture and broadcasting system
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
SIAM Review
Keeping multiple objects in the field of view of a single PTZ camera
ACC'09 Proceedings of the 2009 conference on American Control Conference
Computer Vision and Image Understanding
Auto-directed video stabilization with robust L1 optimal camera paths
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Region of interest extraction and virtual camera control based on panoramic video capturing
IEEE Transactions on Multimedia
Monocular object detection using 3d geometric primitives
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part I
Interactive Zoom and Panning from Live Panoramic Video
Proceedings of Network and Operating System Support on Digital Audio and Video Workshop
Proceedings of the 5th ACM Multimedia Systems Conference
Hi-index | 0.00 |
We present a method to generate aesthetic video from a robotic camera by incorporating a virtual camera operating on a delay, and a hybrid controller which uses feedback from both the robotic and virtual cameras. Our strategy employs a robotic camera to follow a coarse region-of-interest identified by a realtime computer vision system, and then resamples the captured images to synthesize the video that would have been recorded along a smooth, aesthetic camera trajectory. The smooth motion trajectory is obtained by operating the virtual camera on a short delay so that perfect knowledge of immediate future events is known. Previous autonomous camera installations have employed either robotic cameras or stationary wide-angle cameras with subregion cropping. Robotic cameras track the subject using realtime sensor data, and regulate a smoothness-latency trade-off through control gains. Fixed cameras post-process the data and suffer significant reductions in image resolution when the subject moves freely over a large area. Our approach provides a solution for broadcasting events from locations where camera operators cannot easily access. We can also offer broadcasters additional actuated camera angles without the overhead of additional human operators. Experiments on our prototype system for college basketball illustrate how our approach better mimics human operators compared to traditional robotic control approaches, while avoiding the loss in resolution that occurs from fixed camera system.