BodyAvatar: creating freeform 3D avatars using first-person body gestures

Authors:
Yupeng Zhang;Teng Han;Zhimin Ren;Nobuyuki Umetani;Xin Tong;Yang Liu;Takaaki Shiratori;Xiang Cao
Affiliations:
Microsoft Research Asia, University of Science & Technology of China, Beijing, China;Microsoft Research Asia, University of Bristol, Beijing, China;Microsoft Research Asia, University of North Carolina at Chapel Hill, Beijing, China;Microsoft Research Asia, The University of Tokyo, Beijing, China;Microsoft Research Asia, Beijing, China;Microsoft Research Asia, Beijing, China;Microsoft Research Asia, Beijing, China;Microsoft Research Asia, Lenovo Research & Technology, Beijing, China
Venue:
Proceedings of the 26th annual ACM symposium on User interface software and technology
Year:
2013

Citing 18
Cited 0

Polygonization of implicit surfaces

Computer Aided Geometric Design
SKETCH: an interface for sketching 3D scenes

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
3D object modeling using spatial and pictographic gestures

VRST '98 Proceedings of the ACM symposium on Virtual reality software and technology
Teddy: a sketching interface for 3D freeform design

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
An iterative design methodology for user-friendly natural language office information applications

ACM Transactions on Information Systems (TOIS)
Virtual clay: a real-time sculpting system with haptic toolkits

I3D '01 Proceedings of the 2001 symposium on Interactive 3D graphics
Surface drawing: creating organic 3D shapes with the hand and tangible tools

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Computer puppetry: An importance-based approach

ACM Transactions on Graphics (TOG)
Finger Sculpting with Digital Clay: 3D Shape Input and Output through a Computer-Controlled Real Surface

SMI '03 Proceedings of the Shape Modeling International 2003
An interface for virtual 3D sculpting via physical proxy

Proceedings of the 4th international conference on Computer graphics and interactive techniques in Australasia and Southeast Asia
Automatic rigging and animation of 3D characters

ACM SIGGRAPH 2007 papers
ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models

Proceedings of the 21st annual ACM symposium on User interface software and technology
Data miming: inferring spatial object descriptions from human gesture

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
KidCAD: digitally remixing toys through tangible tools

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A handle bar metaphor for virtual object manipulation with mid-air interaction

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
KinÊtre: animating the world with the human body

Proceedings of the 25th annual ACM symposium on User interface software and technology
Hand pose estimation and hand shape classification using multi-layered randomized decision forests

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI

Quantified Score

Hi-index	0.00

Visualization

Abstract

BodyAvatar is a Kinect-based interactive system that allows users without professional skills to create freeform 3D avatars using body gestures. Unlike existing gesture-based 3D modeling tools, BodyAvatar centers around a first-person "you're the avatar" metaphor, where the user treats their own body as a physical proxy of the virtual avatar. Based on an intuitive body-centric mapping, the user performs gestures to their own body as if wanting to modify it, which in turn results in corresponding modifications to the avatar. BodyAvatar provides an intuitive, immersive, and playful creation experience for the user. We present a formative study that leads to the design of BodyAvatar, the system's interactions and underlying algorithms, and results from initial user trials.