A hybrid CBR-IR approach to legal information retrieval
ICAIL '95 Proceedings of the 5th international conference on Artificial intelligence and law
Detecting change in legal concepts
ICAIL '95 Proceedings of the 5th international conference on Artificial intelligence and law
Survey on structure-based case retrieval
The Knowledge Engineering Review
| Hi-index | 0.00 |
In this article we evaluate the BankXX program from several perspectives. BankXX is a case-based legal argument program that retrieves cases and other legal knowledge pertinent to a legal argument through a combination of heuristic search and knowledge-based indexing. The program is described in detail in a companion article in (this issue of) the Journal of Artificial Intelligence and Law. Three perspectives are used to evaluate BankXX: (1) classical information retrieval measures of precision and recall applied against a hand-coded baseline; (2) knowledge- representation and case-based reasoning perspectives, where the baseline is provided by the functionality of a well-known case-based argument program, HYPO [Ashley, 1990]; and (3) search perspective, in which the performance of BankXX run with various parameter settings, for instance, resource limits, is compared. In this article we report on an extensive series of experiments performed to evaluate the program. We also describe two brief experiments on ancillary questions regarding the program''s search behavior and knowledge representation. Finally we offer some general conclusions that might be drawn from these particular experiments.