Theoretical Computer Science
A logical framework for depiction and image interpretation
Artificial Intelligence
Building visual language parsers
CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Three lectures on situation theoretic grammar
EAIA '90 Proceedings of the 2nd advanced school in artifical intelligence on Natural language processing
Definite-clause set grammars: a formalism for problem solving
Journal of Logic Programming
Using spatial logic to describe visual languages
Artificial Intelligence Review - Special issue on integration of natural language and vision processing: recent advances
Information flow: the logic of distributed systems
Information flow: the logic of distributed systems
Operational constraints in diagrammatic reasoning
Logical reasoning with diagrams
Situation-theoretic account of valid reasoning with Venn diagrams
Logical reasoning with diagrams
A survey of visual language specification and recognition
Visual language theory
A fully formalized theory for describing visual notations
Visual language theory
Diaplan: a decidable diagrammatic proof system for planning in the blocks world
Diaplan: a decidable diagrammatic proof system for planning in the blocks world
A declarative specification and semantics for visual languages
Journal of Visual Languages and Computing
Deductive Parsing of Visual Languages
LACL '01 Proceedings of the 4th International Conference on Logical Aspects of Computational Linguistics
Compositional Semantics for Diagrams Using Constrained Objects
DIAGRAMS '02 Proceedings of the Second International Conference on Diagrammatic Representation and Inference
Visual Multiset Rewriting: Applications to Diagram Parsing and Reasoning
WMP '00 Proceedings of the Workshop on Multiset Processing: Multiset Processing, Mathematical, Computer Science, and Molecular Computing Points of View
Twelve years of diagrams research
Journal of Visual Languages and Computing
| Hi-index | 0.00 |
A key component of computational diagrammatic reasoning is the automated interpretation of diagram notations. One common and successful approach to this is based on attributed multiset grammars. The disadvantages of grammars are, however, that they do not allow ready integration of semantic information and that the underlying theory is not strongly developed. Therefore, embeddings of grammars into first-order logic have been investigated. Unfortunately, these are unsatisfactory: Either they are complex and unnatural or else, because of the monotonicity of classical first-order logic, cannot handle diagrammatic reasoning. We investigate the use of two non-standard logics, namely linear logic and situation theory, for the formalization of diagram interpretation and reasoning. The chief advantage of linear logic is that it is a resource-oriented logic, which renders the embedding of grammars straightforward. Situation theory, on the other hand, has been designed for capturing the semantics of natural language and offers powerful methods for modelling more complex aspects of language, such as incomplete views of the world. The paper illustrates embeddings of grammar-based interpretation into both formalisms and also discusses their integration.