Using Evaluation to Shape ITS Design: Results and Experiences with SQL-Tutor
User Modeling and User-Adapted Interaction
Automatic Problem Generation in Constraint-Based Tutors
ITS '02 Proceedings of the 6th International Conference on Intelligent Tutoring Systems
Authoring Web-Based Tutoring Systems with WETAS
ICCE '02 Proceedings of the International Conference on Computers in Education
Recasting the feedback debate: benefits of tutoring error detection and correction skills
Recasting the feedback debate: benefits of tutoring error detection and correction skills
Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)
Modeling the Acquisition of Fluent Skill in Educational Action Games
UM '07 Proceedings of the 11th international conference on User Modeling
An Intelligent SQL Tutor on the Web
International Journal of Artificial Intelligence in Education
Collaborative Information Filtering: A Review and an Educational Application
International Journal of Artificial Intelligence in Education
Interacting with Inspectable Bayesian Student Models
International Journal of Artificial Intelligence in Education
Expertise, Motivation and Teaching in Learning Companion Systems
International Journal of Artificial Intelligence in Education
Evaluating the REDEEM Authoring Tool: Can Teachers Create Effective Learning Environments?
International Journal of Artificial Intelligence in Education
An Intelligent Tutoring System for Entity Relationship Modelling
International Journal of Artificial Intelligence in Education
On Using Learning Curves to Evaluate ITS
Proceedings of the 2005 conference on Artificial Intelligence in Education: Supporting Learning through Intelligent and Socially Informed Technology
Proceedings of the 2007 conference on Artificial Intelligence in Education: Building Technology Rich Learning Contexts That Work
The effect of adapting feedback generality in ITS
AH'06 Proceedings of the 4th international conference on Adaptive Hypermedia and Adaptive Web-Based Systems
A decomposition model for the layered evaluation of interactive adaptive systems
UM'05 Proceedings of the 10th international conference on User Modeling
Intelligent tutoring systems, educational data mining, and the design and evaluation of video games
ITS'10 Proceedings of the 10th international conference on Intelligent Tutoring Systems - Volume Part II
Learning factors analysis – a general method for cognitive model evaluation and improvement
ITS'06 Proceedings of the 8th international conference on Intelligent Tutoring Systems
Proceedings of the International Working Conference on Advanced Visual Interfaces
Hi-index | 0.00 |
Personalised environments such as adaptive educational systems can be evaluated and compared using performance curves. Such summative studies are useful for determining whether or not new modifications enhance or degrade performance. Performance curves also have the potential to be utilised in formative studies that can shape adaptive model design at a much finer level of granularity. We describe the use of learning curves for evaluating personalised educational systems and outline some of the potential pitfalls and how they may be overcome. We then describe three studies in which we demonstrate how learning curves can be used to drive changes in the user model. First, we show how using learning curves for subsets of the domain model can yield insight into the appropriateness of the model's structure. In the second study we use this method to experiment with model granularity. Finally, we use learning curves to analyse a large volume of user data to explore the feasibility of using them as a reliable method for fine-tuning a system's model. The results of these experiments demonstrate the successful use of performance curves in formative studies of adaptive educational systems.