Image-based clothes animation for virtual fitting

Authors:
Zhenglong Zhou;Bo Shu;Shaojie Zhuo;Xiaoming Deng;Ping Tan;Stephen Lin
Affiliations:
National University of Singapore;National University of Singapore;National University of Singapore;National University of Singapore and Institute of Software, Chinese Academy of Sciences;National University of Singapore;Microsoft Research Asia
Venue:
SIGGRAPH Asia 2012 Technical Briefs
Year:
2012

Citing 16
Cited 3

Video Rewrite: driving visual speech with audio

Proceedings of the 24th annual conference on Computer graphics and interactive techniques
An optimal algorithm for approximate nearest neighbor searching fixed dimensions

Journal of the ACM (JACM)
Voice puppetry

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Video textures

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Controlled animation of video sprites

Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation
Video-based character animation

Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation
Image deformation using moving least squares

ACM SIGGRAPH 2006 Papers
Human video textures

Proceedings of the 2009 symposium on Interactive 3D graphics and games
Tracking and Retexturing Cloth for Real-Time Virtual Clothing Applications

MIRAGE '09 Proceedings of the 4th International Conference on Computer Vision/Computer Graphics CollaborationTechniques
Video-based reconstruction of animatable human characters

ACM SIGGRAPH Asia 2010 papers
MovieReshape: tracking and reshaping of humans in videos

ACM SIGGRAPH Asia 2010 papers
Video-based characters: creating new human performances from a multi-view video database

ACM SIGGRAPH 2011 papers
Free viewpoint virtual try-on with commodity depth cameras

Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
Image-based clothes transfer

ISMAR '11 Proceedings of the 2011 10th IEEE International Symposium on Mixed and Augmented Reality
Efficient regression of general-activity human poses from depth images

ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Home 3D body scans from noisy image and range data

ICCV '11 Proceedings of the 2011 International Conference on Computer Vision

Real-time image-based animation using morphing with human skeletal tracking

Proceedings of the 1st symposium on Spatial user interaction
Depth image based cloth deformation for virtual try-on

ACM SIGGRAPH 2013 Posters
Human-engine: viewing 4D mesh captures on mobile devices

SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

We propose an image-based approach for virtual clothes fitting, in which a user moves freely in front of a virtual mirror (i.e., video screen) that displays the user wearing a superimposed virtual garment. The motions and deformations of the virtual garment are synthesized by tracking the user's skeleton and utilizing corresponding video clips of the actual garment worn by a model. Our system overcomes challenges in generating a convincing garment animation. With our technique, we developed a real-time system using a Microsoft Kinect camera that demonstrates effective clothes fitting results with a variety of garment types.