Interacting with paper on the DigitalDesk
Communications of the ACM - Special issue on computer augmented environments: back to the real world
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
OBBTree: a hierarchical structure for rapid interference detection
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Tangible bits: towards seamless interfaces between people, bits and atoms
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
CyberCode: designing augmented reality environments with visual tags
DARE '00 Proceedings of DARE 2000 on Designing augmented reality environments
SnakeToonz: a semi-automatic approach to creating cel animation from video
NPAR '02 Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering
IEEE Computer Graphics and Applications
A sketching interface for articulated figure animation
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Object Recognition from Local Scale-Invariant Features
ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
The Self-Organizing Desk
Layered acting for character animation
ACM SIGGRAPH 2003 Papers
Motion sketching for control of rigid-body simulations
ACM Transactions on Graphics (TOG)
Motion doodles: an interface for sketching character motion
ACM SIGGRAPH 2004 Papers
MathPad2: a system for the creation and exploration of mathematical sketches
ACM SIGGRAPH 2004 Papers
ACM SIGGRAPH 2004 Papers
Keyframe-based tracking for rotoscoping and animation
ACM SIGGRAPH 2004 Papers
Video-based document tracking: unifying your physical and electronic desktops
Proceedings of the 17th annual ACM symposium on User interface software and technology
ARTag, a Fiducial Marker System Using Digital Techniques
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Immersive authoring: What You eXperience Is What You Get (WYXIWYG)
Communications of the ACM - Designing for the mobile device
ACM SIGGRAPH 2005 Papers
As-rigid-as-possible shape manipulation
ACM SIGGRAPH 2005 Papers
PlayAnywhere: a compact interactive tabletop projection-vision system
Proceedings of the 18th annual ACM symposium on User interface software and technology
ACM SIGGRAPH 2006 Papers
ACM SIGGRAPH 2006 Papers
Video motion analysis for the synthesis of dynamic cues and Futurist art
Graphical Models - Special issue on the vision, video and graphics conference 2005
Video watercolorization using bidirectional texture advection
ACM SIGGRAPH 2007 papers
K-sketch: a 'kinetic' sketch pad for novice animators
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Resolving ambiguities to create a natural computer-based sketching environment
IJCAI'01 Proceedings of the 17th international joint conference on Artificial intelligence - Volume 2
Video Paintbox: The fine art of video painting
Computers and Graphics
Real-time hand-tracking with a color glove
ACM SIGGRAPH 2009 papers
FrameWire: a tool for automatically extracting interaction logic from paper prototyping tests
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Engaging spect-actors with multimodal digital puppetry
Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Modeling 2.5D plants from ink paintings
Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium
Multitouch puppetry: creating coordinated 3D motion for an articulated arm
ACM International Conference on Interactive Tabletops and Surfaces
SandCanvas: a multi-touch art medium inspired by sand animation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
ShadowStory: creative and collaborative digital storytelling inspired by cultural heritage
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Layered interpolation for interactive avatar control
Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
3D puppetry: a kinect-based interface for 3D animation
Proceedings of the 25th annual ACM symposium on User interface software and technology
KinÊtre: animating the world with the human body
Proceedings of the 25th annual ACM symposium on User interface software and technology
FingerWalking: motion editing with contact-based hand performance
EUROSCA'12 Proceedings of the 11th ACM SIGGRAPH / Eurographics conference on Computer Animation
Finger walking: motion editing with contact-based hand performance
Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation
FingerDraw: more than a digital paintbrush
Proceedings of the 4th Augmented Human International Conference
Flexpad: highly flexible bending interactions for projected handheld displays
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
eHeritage of shadow puppetry: creation and manipulation
Proceedings of the 21st ACM international conference on Multimedia
Hi-index | 0.00 |
We present a video-based interface that allows users of all skill levels to quickly create cutout-style animations by performing the character motions. The puppeteer first creates a cast of physical puppets using paper, markers and scissors. He then physically moves these puppets to tell a story. Using an inexpensive overhead camera our system tracks the motions of the puppets and renders them on a new background while removing the puppeteer's hands. Our system runs in real-time (at 30 fps) so that the puppeteer and the audience can immediately see the animation that is created. Our system also supports a variety of constraints and effects including articulated characters, multi-track animation, scene changes, camera controls, 2 1/2-D environments, shadows, and animation cycles. Users have evaluated our system both quantitatively and qualitatively: In tests of low-level dexterity, our system has similar accuracy to a mouse interface. For simple story telling, users prefer our system over either a mouse interface or traditional puppetry. We demonstrate that even first-time users, including an eleven-year-old, can use our system to quickly turn an original story idea into an animation.