Understanding text with an accompanying diagram
IEA/AIE '88 Proceedings of the 1st international conference on Industrial and engineering applications of artificial intelligence and expert systems - Volume 2
The structure-mapping engine: algorithm and examples
Artificial Intelligence
Natural language understanding (2nd ed.)
Natural language understanding (2nd ed.)
The figure understander: a system for integrating text and diagram input to a knowledge base
IEA/AIE '94 Proceedings of the 7th international conference on Industrial and engineering applications of artificial intelligence and expert systems
Multimedia Learning
Calculi for Qualitative Spatial Reasoning
AISMC-3 Proceedings of the International Conference AISMC-3 on Artificial Intelligence and Symbolic Mathematical Computation
Diagram understanding using integration of layout information and textual information
COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 2
Capturing and answering questions posed to a knowledge-based system
Proceedings of the 4th international conference on Knowledge capture
Enabling experts to build knowledge bases from science textbooks
Proceedings of the 4th international conference on Knowledge capture
Learning by reading: a prototype system, performance baseline and lessons learned
AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 1
CogSketch: open-domain sketch understanding for cognitive science research and for education
SBM'08 Proceedings of the Fifth Eurographics conference on Sketch-Based Interfaces and Modeling
Analogical dialogue acts: supporting learning by reading analogies
FAM-LbR '10 Proceedings of the NAACL HLT 2010 First International Workshop on Formalisms and Methodology for Learning by Reading
| Hi-index | 0.00 |
Many information sources use multiple modalities, such as textbooks, which contain both text and diagrams. Each captures information that is hard to express in the other, and evidence suggests that multimodal information leads to better retention and transfer in human learners. This paper describes a system that captures textbook knowledge, using simplified English text and sketched versions of diagrams. We present experimental results showing it can use captured knowledge to answer questions from the textbook's curriculum.