EISEval, a generic reconfigurable environment for evaluating agent-based interactive systems

  • Authors:
  • Chi Dung Tran;Houcine Ezzedine;Christophe Kolski

  • Affiliations:
  • LIMA Laboratory, DRT, CEA List, Atomic Energy and Alternative Energies Commission, Saclay, France;Univ Lille Nord de France, F-59000 Lille, France and UVHC, LAMIH, F-59313 Valenciennes, France and CNRS, UMR 8201, F-59313 Valenciennes, France;Univ Lille Nord de France, F-59000 Lille, France and UVHC, LAMIH, F-59313 Valenciennes, France and CNRS, UMR 8201, F-59313 Valenciennes, France

  • Venue:
  • International Journal of Human-Computer Studies
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

The evaluation of interactive systems has been an active subject of research for many years. Many methods have been proposed, but most of them do not take the architectural specificities of an agent-based interactive system into account, nor do they focus on the link between architecture and evaluation. In this paper, we present an agent-based architecture model for interactive systems. Then, based on this architecture, we propose a generic, reconfigurable evaluation environment, called EISEval, designed and developed to help evaluators analyze and evaluate certain aspects of interactive systems in general and of agent-based architecture interactive systems in particular: User Interface (UI), non-functional properties (e.g., response time, complexity) and user characteristics (e.g., abilities, preferences, progress). System designers can draw useful conclusions from the evaluation results to improve the system. This environment was applied to evaluate an agent-based interactive system used to supervise an urban transport network in a study organized in laboratory.