Evaluating Subject Matter Experts' Learning and Use of an ITS Authoring Tool

  • Authors:
  • Brenda M. Wenzel;Mary T. Dirnberger;Pat Y. Hsieh;Tom J. Chudanov;Henry M. Halff

  • Affiliations:
  • -;-;-;-;-

  • Venue:
  • ITS '98 Proceedings of the 4th International Conference on Intelligent Tutoring Systems
  • Year:
  • 1998

Quantified Score

Hi-index 0.00

Visualization

Abstract

Because ITSs offer knowledge-based instruction, ITS authoring shells can use knowledge acquisition systems to bring courseware development within the reach of subject-matter experts unskilled in instructional design and development. The Experimental Advanced Instructional Design Advisor (XAIDA), a simple ITS shell, was evaluated in a study of 17 Air Force medical-technician trainers. The study examined XAIDA's learnability, usability, and acceptability to the participants using a one-week combined training and evaluation program. All participants were able to produce courseware using XAIDA. Measures of cognitive structure indicated that their conception of XAIDA's features became more similar to that of an expert as the result of training. Performance tests, skill ratings and usability ratings indicated that XAIDA is both usable and learnable. Participant's attitudes were generally positive except at a point when training required a difficult cognitive shift. Attitudes remained focused througout training on personal and low-level concerns, indicating the participants were not likely to be early adapters of the technology. The results have implications for the deployment of ITS shells in operational environments.