Attention, intentions, and the structure of discourse
Computational Linguistics
Synergistic use of direct manipulation and natural language
CHI '89 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The structure-mapping engine: algorithm and examples
Artificial Intelligence
Qualitative spatial reasoning: the CLOCK project
Artificial Intelligence - Special issue: Qualitative reasoning about physical systems II
The role of natural language in a multimodal interface
UIST '92 Proceedings of the 5th annual ACM symposium on User interface software and technology
Multimodal user interfaces in the Open Agent Architecture
Proceedings of the 2nd international conference on Intelligent user interfaces
Sketching storyboards to illustrate interface behaviors
Conference Companion on Human Factors in Computing Systems
QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Readings in intelligent user interfaces
Readings in intelligent user interfaces
Ten myths of multimodal interaction
Communications of the ACM
On Line and on Paper: Visual Representations, Visual Culture, and Computer Graphics in Design Engineering
Qualitative Spatial Interpretation of Course-of-Action Diagrams
Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence
GeoRep: A Flexible Tool for Spatial Representation of Line Drawings
Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence
Calculi for Qualitative Spatial Reasoning
AISMC-3 Proceedings of the International Conference AISMC-3 on Artificial Intelligence and Symbolic Mathematical Computation
“Put-that-there”: Voice and gesture at the graphics interface
SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
Perceptual organization in an interactive sketch editing application
ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Multimodal Interfaces for Multimedia Information Agents
ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97) -Volume 1 - Volume 1
Pattern recognition and beautification for a pen based interface
ICDAR '95 Proceedings of the Third International Conference on Document Analysis and Recognition (Volume 1) - Volume 1
Generating multiple new designs from a sketch
AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 2
Sketching for knowledge capture: a progress report
Proceedings of the 7th international conference on Intelligent user interfaces
Sketching for military courses of action diagrams
Proceedings of the 8th international conference on Intelligent user interfaces
How Qualitative Spatial Reasoning Can Improve Strategy Game AIs
IEEE Intelligent Systems
AI on the battlefield: an experimental exploration
Eighteenth national conference on Artificial intelligence
Incorporating AI into Military Decision Making: An Experiment
IEEE Intelligent Systems
Speech and sketching for multimodal design
Proceedings of the 9th international conference on Intelligent user interfaces
Object-action association: a HCI design model
Proceedings of the 9th international conference on Intelligent user interfaces
Perceptually-supported image editing of text and graphics
Proceedings of the 16th annual ACM symposium on User interface software and technology
Drawing marks, acts, and reacts: Toward a computational sketching interface for architectural design
Artificial Intelligence for Engineering Design, Analysis and Manufacturing
Naturally conveyed explanations of device behavior
Proceedings of the 2001 workshop on Perceptive user interfaces
Qualitative spatial reasoning about sketch maps
AI Magazine
Naturally conveyed explanations of device behavior
ACM SIGGRAPH 2006 Courses
Speech and sketching for multimodal design
ACM SIGGRAPH 2006 Courses
Speech and sketching for multimodal design
ACM SIGGRAPH 2007 courses
Newton's Pen: a pen-based tutoring system for statics
SBIM '07 Proceedings of the 4th Eurographics workshop on Sketch-based interfaces and modeling
Kirchhoff's Pen: a pen-based circuit analysis tutor
SBIM '07 Proceedings of the 4th Eurographics workshop on Sketch-based interfaces and modeling
A collaborative face-to-face design support system based on sketching and gesturing
Advanced Engineering Informatics
Newton's Pen: A pen-based tutoring system for statics
Computers and Graphics
Reasoning about Hand-Drawn Sketches: An Approach Based on Intelligent Software Agents
VISUAL '08 Proceedings of the 10th international conference on Visual Information Systems: Web-Based Visual Information Search and Management
Modeling Cross-Cultural Performance on the Visual Oddity Task
Proceedings of the international conference on Spatial Cognition VI: Learning, Reasoning, and Talking about Space
Visually-Driven Decision Making Using Handheld Devices
Proceedings of the 2008 conference on Collaborative Decision Making: Perspectives and Challenges
UISK: Supporting Model-Driven and Sketch-Driven Paperless Prototyping
Proceedings of the 13th International Conference on Human-Computer Interaction. Part I: New Trends
Using spatial language in multi-modal knowledge capture
AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 3
AI on the battlefield: an experimental exploration
IAAI'02 Proceedings of the 14th conference on Innovative applications of artificial intelligence - Volume 1
Design sketches and sketch design tools
Knowledge-Based Systems
New ideas on the artificial intelligence support in military applications
AIKED'10 Proceedings of the 9th WSEAS international conference on Artificial intelligence, knowledge engineering and data bases
Analyzing the roles of PDA in meeting scenarios
CRIWG'06 Proceedings of the 12th international conference on Groupware: design, implementation, and use
CogSketch: open-domain sketch understanding for cognitive science research and for education
SBM'08 Proceedings of the Fifth Eurographics conference on Sketch-Based Interfaces and Modeling
Automatic interpretation of depiction conventions in sketched diagrams
SBM'08 Proceedings of the Fifth Eurographics conference on Sketch-Based Interfaces and Modeling
Hi-index | 0.00 |
Sketching is a powerful means of interpersonal communication. While many useful multimodal systems have been created, current systems are far from achieving human-like participation in sketching. A computational model of sketching would help characterize these differences and help us better understand how to overcome them. This paper is a first step towards such a model. We start with an example of a sketching system(nuSketch COA Creator)designed to aid military planners, to provide context and a source of examples. We then describe four dimensions of sketching,visual understanding, conceptual understanding, language understanding,anddrawing,that can be used to characterize the competence of existing systems and identify open problems. The issues involved will be illustrated by examples from our experience with nuSketch. Three research challenges are posed, to serve as milestones towards a computational model of sketching that can explain and replicate human abilities in this area.