Using Reinforcement Learning for Similarity Assessment in Case-Based Systems

Authors:
Paul Juell;Patrick Paulson
Affiliations:
-;-
Venue:
IEEE Intelligent Systems
Year:
2003

Citing 14
Cited 8

Introduction to the theory of neural computation

Introduction to the theory of neural computation
A Nearest Hyperrectangle Learning Method

Machine Learning
Tolerating noisy, irrelevant and novel attributes in instance-based learning algorithms

International Journal of Man-Machine Studies - Special issue: symbolic problem solving in noisy and novel task environments
A Review and Empirical Evaluation of Feature Weighting Methods for aClass of Lazy Learning Algorithms

Artificial Intelligence Review - Special issue on lazy learning
Hybrid approaches for integrating neural networks and case based reasoning: from loosely coupled to tightly coupled models

Soft computing in case based reasoning
Towards integration of memory based learning and neural networks

Soft computing in case based reasoning
Feature Weight Maintenance in Case Bases Using Introspective Learning

Journal of Intelligent Information Systems
The Application of Case-Based Reasoning to the Tasks of Health Care Planning

EWCBR '93 Selected papers from the First European Workshop on Topics in Case-Based Reasoning
Learning to Refine Indexing by Introspective Reasoning

ICCBR '95 Proceedings of the First International Conference on Case-Based Reasoning Research and Development
Learning a Local Similarity Metric for Case-Based Reasoning

ICCBR '95 Proceedings of the First International Conference on Case-Based Reasoning Research and Development
Using Introspective Learning to Improve Retrieval in CBR: A Case Study in Air Traffic Control

ICCBR '97 Proceedings of the Second International Conference on Case-Based Reasoning Research and Development
Dynamic Refinement of Feature Weights Using Quantitative Introspective Learning

IJCAI '99 Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence
Reinforcement learning: a survey

Journal of Artificial Intelligence Research
Storing and indexing plan derivations through explanation-based analysis of retrieval failures

Journal of Artificial Intelligence Research

Improving Reinforcement Learning by Using Case Based Heuristics

ICCBR '09 Proceedings of the 8th International Conference on Case-Based Reasoning: Case-Based Reasoning Research and Development
Case-based recommendation

The adaptive web
Case-Based Multiagent Reinforcement Learning: Cases as Heuristics for Selection of Actions

Proceedings of the 2010 conference on ECAI 2010: 19th European Conference on Artificial Intelligence
Towards constraint optimal control of greenhouse climate

LSMS/ICSEE'10 Proceedings of the 2010 international conference on Life system modeling and simulation and intelligent computing, and 2010 international conference on Intelligent computing for sustainable energy and environment: Part III
Coordination control of greenhouse environmental factors

International Journal of Automation and Computing
Reducing the memory footprint of temporal difference learning over finitely many states by using case-based generalization

ICCBR'10 Proceedings of the 18th international conference on Case-Based Reasoning Research and Development
Using cases as heuristics in reinforcement learning: a transfer learning application

IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
Integrated learning for goal-driven autonomy

IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Three

Quantified Score

Hi-index	0.00

Visualization

Abstract

The reinforcement-trained case-based reasoning system uses reinforcement learning to adjust its similarity metric. RETCBR learns similarity metrics in response to feedback from the user or environment, letting the system adapt to user needs. The system also works in application domains with insufficient expertise to develop similarity metrics, expanding the type of problems to which CBR can be applied. The authors describe two methods of implementing similarity assessment and demonstrate the methods'performance in a weather forecasting application. The weather application uses reports obtained from actual weather stations and demonstrates that the system can operate without explicit domain knowledge. The experiments show that CBR systems can improve their similarity metrics through reinforcement-learning techniques.