Evaluating adaptive work-integrated learning systems: from the lab to the field

Authors:
Barbara Kump;Tobias Ley;Stefanie Lindstaedt
Affiliations:
Know-Center GmbH, Graz, Austria and Knowledge Management Institute, TU Graz, Graz, Austria;Center for Educational Technologies, Tallinn Univ., Tallinn, Estonia;Know-Center GmbH, Graz, Austria and Knowledge Management Institute, TU Graz, Graz, Austria
Venue:
EC-TEL'11 Proceedings of the 6th European conference on Technology enhanced learning: towards ubiquitous learning
Year:
2011

Citing 6
Cited 0

User-centered evaluation of adaptive and adaptable systems: A literature review

The Knowledge Engineering Review
Evaluating the Adaptation of a Learning System before the Prototype Is Ready: A Paper-Based Lab Study

UMAP '09 Proceedings of the 17th International Conference on User Modeling, Adaptation, and Personalization: formerly UM and AH
Supporting the Learning Dimension of Knowledge Work

EC-TEL '09 Proceedings of the 4th European Conference on Technology Enhanced Learning: Learning in the Synergy of Multiple Disciplines
A methodology for eliciting, modelling, and evaluating expert knowledge for an adaptive work-integrated learning system

International Journal of Human-Computer Studies
Layered evaluation of interactive adaptive systems: framework and formative methods

User Modeling and User-Adapted Interaction
Scaffolding self-directed learning with personalized learning goal recommendations

UMAP'10 Proceedings of the 18th international conference on User Modeling, Adaptation, and Personalization

Quantified Score

Hi-index	0.00

Visualization

Abstract

Evaluation frameworks have been presented that suggest layered evaluation of adaptive systems along two dimensions: (i) the software development cycle, and (ii) the component of the adaptive system that shall be looked at. We argue that a third dimension is crucial: the question whether an evaluation should take place in the lab or in the field. We present a refined systematization of evaluation approaches using the evaluation of the adaptive WIL system APOSDLE as an example.