First Sight: A Human Body Outline Labeling System
IEEE Transactions on Pattern Analysis and Machine Intelligence
Machine vision
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Pfinder: Real-Time Tracking of the Human Body
IEEE Transactions on Pattern Analysis and Machine Intelligence
Reflectance and texture of real-world surfaces
ACM Transactions on Graphics (TOG)
The visual analysis of human movement: a survey
Computer Vision and Image Understanding
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Tracking and modeling people in video sequences
Computer Vision and Image Understanding - Modeling people toward vision-based underatanding of a person's shape, appearance, and movement
Unstructured lumigraph rendering
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Understanding Motion Capture for Computer Animation and Video Games
Understanding Motion Capture for Computer Animation and Video Games
Articulated body deformation from range scan data
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
A silhoutte based technique for the reconstruction of human movement
Computer Vision and Image Understanding
A silhouette-based algorithm for texture registration and stitching
Graphical Models
Spatio-temporal view interpolation
EGRW '02 Proceedings of the 13th Eurographics workshop on Rendering
Virtual View Generation for 3D Digital Video
IEEE MultiMedia
The Visual Hull Concept for Silhouette-Based Image Understanding
IEEE Transactions on Pattern Analysis and Machine Intelligence
Polyhedral Visual Hulls for Real-Time Rendering
Proceedings of the 12th Eurographics Workshop on Rendering Techniques
Estimating Body Animation Parameters From Depth Images Using Analysis By Synthesis
DCV '01 Proceedings of the Second International Workshop on Digital and Computational Video
A Distributed System for Real-Time Volume Reconstruction
CAMP '00 Proceedings of the Fifth IEEE International Workshop on Computer Architectures for Machine Perception (CAMP'00)
3-D model-based tracking of humans in action: a multi-view approach
CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Tracking People with Twists and Exponential Maps
CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Real-time human motion analysis and IK-based human figure control
HUMO '00 Proceedings of the Workshop on Human Motion (HUMO'00)
PG '02 Proceedings of the 10th Pacific Conference on Computer Graphics and Applications
Combining 2D Feature Tracking and Volume Reconstruction for Online Video-Based Human Motion Capture
PG '02 Proceedings of the 10th Pacific Conference on Computer Graphics and Applications
PG '02 Proceedings of the 10th Pacific Conference on Computer Graphics and Applications
3D Articulated Models and Multi-View Tracking with Silhouettes
ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
Constructing Virtual Worlds Using Dense Stereo
ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Enhancing Silhouette-Based Human Motion Capture with 3D Motion Fields
PG '03 Proceedings of the 11th Pacific Conference on Computer Graphics and Applications
High-quality video view interpolation using a layered representation
ACM SIGGRAPH 2004 Papers
3D video: being part of the movie
ACM SIGGRAPH Computer Graphics
Breathe easy: model and control of simulated respiration for animation
SCA '04 Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation
Computer Vision and Image Understanding - Model-based and image-based 3D scene representation for interactive visalization
Combining 3D flow fields with silhouette-based human motion capture for immersive video
Graphical Models - Special issue on pacific graphics 2003
International Journal of Computer Vision
Video-based character animation
Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation
Marker-free kinematic skeleton estimation from sequences of volume data
Proceedings of the ACM symposium on Virtual reality software and technology
Learning silhouette features for control of human motion
ACM Transactions on Graphics (TOG)
Proceedings of the 13th annual ACM international conference on Multimedia
Automatic generation of personalized human avatars from multi-view video
Proceedings of the ACM symposium on Virtual reality software and technology
Virtual view synthesis of people from multiple view video sequences
Graphical Models - Special issue: Vision and computer graphics
Breathe easy: model and control of human respiration for computer animation
Graphical Models - Special issue on SCA 2004
Computational studies of human motion: part 1, tracking and motion synthesis
Foundations and Trends® in Computer Graphics and Vision
A survey of advances in vision-based human motion capture and analysis
Computer Vision and Image Understanding - Special issue on modeling people: Vision-based understanding of a person's shape, appearance, movement, and behaviour
Markerless tracking of complex human motions from multiple views
Computer Vision and Image Understanding - Special issue on modeling people: Vision-based understanding of a person's shape, appearance, movement, and behaviour
A system for articulated tracking incorporating a clothing model
Machine Vision and Applications
Efficient multi-viewpoint acquisition of 3D objects undergoing repetitive motions
Proceedings of the 2007 symposium on Interactive 3D graphics and games
Point-sampled 3D video of real-world scenes
Image Communication
Journal of VLSI Signal Processing Systems
Immersive Video Teleconferencing with User-Steerable Views
Presence: Teleoperators and Virtual Environments
Surface Capture for Performance-Based Animation
IEEE Computer Graphics and Applications
Virtualized Reality: Perspectives on 4D Digitization of Dynamic Events
IEEE Computer Graphics and Applications
Stereoscopic Video Synthesis from a Monocular Video
IEEE Transactions on Visualization and Computer Graphics
Seeing People in Different Light-Joint Shape, Motion, and Reflectance Capture
IEEE Transactions on Visualization and Computer Graphics
Using optical flow for step size initialisation in hand tracking by stochastic optimisation
VisHCI '06 Proceedings of the HCSNet workshop on Use of vision in human-computer interaction - Volume 56
Grimage: markerless 3D interactions
ACM SIGGRAPH 2007 emerging technologies
Reconstruction of deforming geometry from time-varying point clouds
SGP '07 Proceedings of the fifth Eurographics symposium on Geometry processing
Vision-based human motion analysis: An overview
Computer Vision and Image Understanding
Optimal Camera Placement for Automated Surveillance Tasks
Journal of Intelligent and Robotic Systems
Real-time 3-D human body tracking using learnt models of behaviour
Computer Vision and Image Understanding
Articulated mesh animation from multi-view silhouettes
ACM SIGGRAPH 2008 papers
Performance capture from sparse multi-view video
ACM SIGGRAPH 2008 papers
Model-based human shape reconstruction from multiple views
Computer Vision and Image Understanding
Perception-motivated interpolation of image sequences
Proceedings of the 5th symposium on Applied perception in graphics and visualization
Space-time surface reconstruction using incompressible flow
ACM SIGGRAPH Asia 2008 papers
EURASIP Journal on Applied Signal Processing - 3DTV: Capture, Transmission, and Display of 3D Video
Human body pose estimation with particle swarm optimisation
Evolutionary Computation
Type-2 Fuzzy Mixture of Gaussians Model: Application to Background Modeling
ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing
Objective quality assessment in free-viewpoint video production
Image Communication
3DTV view generation using uncalibrated pure rotating and zooming cameras
Image Communication
Proceedings of the 2009 symposium on Interactive 3D graphics and games
Efficient reconstruction of nonrigid shape and motion from real-time 3D scanner data
ACM Transactions on Graphics (TOG)
Summarization of 3D Video by Rate-Distortion Trade-off
IEICE - Transactions on Information and Systems
Applicability of Camera Works to Free Viewpoint Videos with Annotation and Planning
IEICE - Transactions on Information and Systems
Computing Epipolar Geometry from Unsynchronized Cameras
IEICE - Transactions on Information and Systems
View-independent human motion classification using image-based reconstruction
Image and Vision Computing
Low-Cost Multi-image Based 3D Human Body Modeling
MIRAGE '09 Proceedings of the 4th International Conference on Computer Vision/Computer Graphics CollaborationTechniques
Shape from silhouette using topology-adaptive mesh deformation
Pattern Recognition Letters
Leveraging the talent of hand animators to create three-dimensional animation
Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Vision-Based Motion Capture of Interacting Multiple People
ICIAP '09 Proceedings of the 15th International Conference on Image Analysis and Processing
Dynamic shape capture using multi-view photometric stereo
ACM SIGGRAPH Asia 2009 papers
Self-organizing approach to moving surface reconstruction
ISCGAV'09 Proceedings of the 9th WSEAS international conference on Signal processing, computational geometry and artificial vision
The multiple-camera 3-D production studio
IEEE Transactions on Circuits and Systems for Video Technology
Temporal segmentation of 3-D video by histogram-based feature vectors
IEEE Transactions on Circuits and Systems for Video Technology
Build your own 3D scanner: optical triangulation for beginners
ACM SIGGRAPH ASIA 2009 Courses
Build your own 3D scanner: 3D photography for beginners
ACM SIGGRAPH 2009 Courses
3D object relighting based on multi-view stereo and image based lighting techniques
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Camera Network Calibration and Synchronization from Silhouettes in Archived Video
International Journal of Computer Vision
Spatio-temporal reflectance sharing for relightable 3D video
MIRAGE'07 Proceedings of the 3rd international conference on Computer vision/computer graphics collaboration techniques
Unstructured video-based rendering: interactive exploration of casually captured videos
ACM SIGGRAPH 2010 papers
Silhouette based generic model adaptation for marker-less motion capturing
Proceedings of the 2nd conference on Human motion: understanding, modeling, capture and animation
3D hand tracking in a stochastic approximation setting
Proceedings of the 2nd conference on Human motion: understanding, modeling, capture and animation
Modeling and tracking line-constrained mechanical systems
RobVis'08 Proceedings of the 2nd international conference on Robot vision
Joint depth-motion dense estimation for multiview video coding
Journal of Visual Communication and Image Representation
Real-time video-based rendering from uncalibrated cameras using plane-sweep algorithm
Journal of Visual Communication and Image Representation
Shape Similarity for 3D Video Sequences of People
International Journal of Computer Vision
Calibration and segmentation free 3D modelling from images based on GPU
International Journal of Computer Applications in Technology
Video-based reconstruction of animatable human characters
ACM SIGGRAPH Asia 2010 papers
Perception-motivated interpolation of image sequences
ACM Transactions on Applied Perception (TAP)
Skeleton and shape adjustment and tracking in multicamera environments
AMDO'10 Proceedings of the 6th international conference on Articulated motion and deformable objects
Automatic moving object segmentation from video sequences using alternate flashing system
EURASIP Journal on Advances in Signal Processing - Special issue on video analysis for human behavior understanding
A multiple camera system with real-time volume reconstruction for articulated skeleton pose tracking
MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part I
Video-based characters: creating new human performances from a multi-view video database
ACM SIGGRAPH 2011 papers
Human-centered visualization environments
Human-centered visualization environments
A novel 3D streaming protocol supported multi-mode display
Journal of Network and Computer Applications
Human motion reconstruction from force sensors
SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Temporally coherent completion of dynamic shapes
ACM Transactions on Graphics (TOG)
Motion structure parsing and motion editing in 3d video
MMM'07 Proceedings of the 13th international conference on Multimedia Modeling - Volume Part I
3D modeling of humans with skeletons from uncalibrated wide baseline views
CAIP'05 Proceedings of the 11th international conference on Computer Analysis of Images and Patterns
Upper body tracking for interactive applications
AMDO'06 Proceedings of the 4th international conference on Articulated Motion and Deformable Objects
Real-Time free-viewpoint video generation using multiple cameras and a PC-Cluster
PCM'04 Proceedings of the 5th Pacific Rim conference on Advances in Multimedia Information Processing - Volume Part I
ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part II
Natural-Textured mesh stream modeling from depth image-based representation
ICCSA'06 Proceedings of the 6th international conference on Computational Science and Its Applications - Volume Part I
Motion composition of 3d video
PCM'06 Proceedings of the 7th Pacific Rim conference on Advances in Multimedia Information Processing
Inter-camera coding of multi-view video using layered depth image representation
PCM'06 Proceedings of the 7th Pacific Rim conference on Advances in Multimedia Information Processing
Animation cartography—intrinsic reconstruction of shape and motion
ACM Transactions on Graphics (TOG)
4D parametric motion graphs for interactive animation
I3D '12 Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games
Parametric control of captured mesh sequences for real-time animation
MIG'11 Proceedings of the 4th international conference on Motion in Games
Towards plenoptic raumzeit reconstruction
Proceedings of the 2010 international conference on Video Processing and Computational Video
3D reconstruction and video-based rendering of casually captured videos
Proceedings of the 2010 international conference on Video Processing and Computational Video
3D human modeling from a single depth image dealing with self-occlusion
Multimedia Tools and Applications
A review on vision techniques applied to Human Behaviour Analysis for Ambient-Assisted Living
Expert Systems with Applications: An International Journal
Parametric animation of performance-captured mesh sequences
Computer Animation and Virtual Worlds
Novel-View Synthesis of Outdoor Sport Events Using an Adaptive View-Dependent Geometry
Computer Graphics Forum
Computational plenoptic imaging
ACM SIGGRAPH 2012 Courses
Compression techniques for 3d video mesh sequences
AMDO'12 Proceedings of the 7th international conference on Articulated Motion and Deformable Objects
Real-time 4d reconstruction of human motion
AMDO'12 Proceedings of the 7th international conference on Articulated Motion and Deformable Objects
Relighting human locomotion with flowed reflectance fields
EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques
A real-time system for full body interaction with virtual worlds
EGVE'04 Proceedings of the Tenth Eurographics conference on Virtual Environments
Performance Capture of High-Speed Motion Using Staggered Multi-View Recording
Computer Graphics Forum
Global Non-rigid Alignment of Surface Sequences
International Journal of Computer Vision
GPU-based real-time spatio-temporal reconstruction studio
Proceedings of the 28th Spring Conference on Computer Graphics
A virtual camera controlling method using multi-touch gestures for capturing free-viewpoint video
Proceedings of the 11th european conference on Interactive TV and video
High detail flexible viewpoint facial video from monocular input using static geometric proxies
Proceedings of the 6th International Conference on Computer Vision / Computer Graphics Collaboration Techniques and Applications
Free-viewpoint video rendering for mobile devices
Proceedings of the 6th International Conference on Computer Vision / Computer Graphics Collaboration Techniques and Applications
Invariant surface-based shape descriptor for dynamic surface encoding
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part I
Real-time high-resolution sparse voxelization with application to image-based modeling
Proceedings of the 5th High-Performance Graphics Conference
| Hi-index | 0.00 |
In free-viewpoint video, the viewer can interactively choose his viewpoint in 3-D space to observe the action of a dynamic real-world scene from arbitrary perspectives. The human body and its motion plays a central role in most visual media and its structure can be exploited for robust motion estimation and efficient visualization. This paper describes a system that uses multi-view synchronized video footage of an actor's performance to estimate motion parameters and to interactively re-render the actor's appearance from any viewpoint.The actor's silhouettes are extracted from synchronized video frames via background segmentation and then used to determine a sequence of poses for a 3D human body model. By employing multi-view texturing during rendering, time-dependent changes in the body surface are reproduced in high detail. The motion capture subsystem runs offline, is non-intrusive, yields robust motion parameter estimates, and can cope with a broad range of motion. The rendering subsystem runs at real-time frame rates using ubiquous graphics hardware, yielding a highly naturalistic impression of the actor. The actor can be placed in virtual environments to create composite dynamic scenes. Free-viewpoint video allows the creation of camera fly-throughs or viewing the action interactively from arbitrary perspectives.