Machine interpretation of line drawings
Machine interpretation of line drawings
Input method of boundary solids by sketching
Computer-Aided Design
Emulating the human interpretation of line-drawings as three-dimensional objects
International Journal of Computer Vision
Constraints for interpretation of line drawings under perspective projection
CVGIP: Image Understanding
An optimization-based approach to the interpretation of single line drawings as 3D wire frames
International Journal of Computer Vision
Creating solid models from single 2D sketches
SMA '95 Proceedings of the third ACM symposium on Solid modeling and applications
Identification of Faces in a 2D Line Drawing Projection of a Wireframe Object
IEEE Transactions on Pattern Analysis and Machine Intelligence
Interpreting a 3D object from a rough 2D line drawing
VIS '90 Proceedings of the 1st conference on Visualization '90
Conceptual design and analysis by sketching
Artificial Intelligence for Engineering Design, Analysis and Manufacturing
3D object reconstruction and representation using neural networks
Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia
Sketching-out virtual humans: from 2D storyboarding to immediate 3D character animation
Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology
Free-Form Sketching of Self-Occluding Objects
IEEE Computer Graphics and Applications
Technical Section: An optimisation-based reconstruction engine for 3D modelling by sketching
Computers and Graphics
A freehand-sketch environment for architectural design supported by a multi-agent system
Computers and Graphics
CAD/Graphics 2013: Sketch2Jewelry: Semantic feature modeling for sketch-based jewelry design
Computers and Graphics
| Hi-index | 0.01 |
We propose a new approach for reconstructing a three-dimensional object from a single two-dimensional freehand line drawing depicting it. A sketch is essentially a noisy projection of a 3D object onto an arbitrary 2D plane. Reconstruction is the inverse projection of the sketched geometry from two dimensions back into three dimensions. While humans can do this reverse-projection remarkably easily and almost without being aware of it, this process is mathematically indeterminate and is very difficult to emulate computationally. Here we propose that the ability of humans to perceive a previously unseen 3D object from a single sketch is based on simple 2D-3D geometrical correlations that are learned from visual experience. We demonstrate how a simple correlation system that is exposed to many object-sketch pairs eventually learns to perform the inverse projection successfully for unseen objects. Conversely, we show how the same correlation data can be used to gauge the understandability of synthetically generated projections of given 3D objects. Using these principles we demonstrate for the first time a completely automatic conversion of a single freehand sketch into a physical solid object. These results have implications for bidirectional human-computer communication of 3D graphic concepts, and might also shed light on the human visual system.