An agent-based framework for sketched symbol interpretation

  • Authors:

  • Giovanni Casella;Vincenzo Deufemia;Viviana Mascardi;Gennaro Costagliola;Maurizio Martelli

  • Affiliations:

  • Dipartimento di Informatica e Scienze dell'Informazione-Universití di Genova Via Dodecaneso 35, 16146, Genova, Italy and Dipartimento di Matematica e Informatica-Universití di Salerno, V ...;Dipartimento di Matematica e Informatica-Universití di Salerno, Via Ponte don Melillo, 84084 Fisciano (SA), Italy;Dipartimento di Informatica e Scienze dell'Informazione-Universití di Genova Via Dodecaneso 35, 16146, Genova, Italy;Dipartimento di Matematica e Informatica-Universití di Salerno, Via Ponte don Melillo, 84084 Fisciano (SA), Italy;Dipartimento di Informatica e Scienze dell'Informazione-Universití di Genova Via Dodecaneso 35, 16146, Genova, Italy

  • Venue:
  • Journal of Visual Languages and Computing
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Recognizing hand-sketched symbols is a definitely complex problem. The input drawings are often intrinsically ambiguous, and require context to be interpreted in a correct way. Many existing sketch recognition systems avoid this problem by recognizing single segments or simple geometric shapes in a stroke. However, for a recognition system to be effective and precise, context must be exploited, and both the simplifications on the sketch features, and the constraints under which recognition may take place, must be reduced to the minimum. In this paper, we present an agent-based framework for sketched symbol interpretation that heavily exploits contextual information for ambiguity resolution. Agents manage the activity of low-level hand-drawn symbol recognizers, that may be heterogeneous for better adapting to the characteristics of each symbol to be recognized, and coordinate themselves in order to exchange contextual information, thus leading to an efficient and precise interpretation of sketches. We also present AgentSketch, a multi-domain sketch recognition system implemented according to the proposed framework. A first experimental evaluation has been performed on the domain of UML Use Case Diagrams to verify the effectiveness of the proposed approach.