Evaluating Expert Systems in a Financial Domain: A Study Demonstrating Issues in Case Selection, Validation Standards and Evaluator Bias

Carol E. Brown, Norma L. Nielson and Mary Ellen Phillips

Intelligent Systems in Accounting, Finance and Management, 1993, vol. 2, issue 2, 81-99

Abstract: This article describes and generalizes a validation study of four commercially available personal financial planning expert systems and the rationale for the research methodology used. Our evaluation of these systems adds to the understanding of verification and validation issues related to case selection, validation standards and evaluator bias. The article describes the systems, their domain and the empirical method—field tests using hypothetical cases—and relates that method to the literature. Comparing same‐task systems combines multiple system perspectives and multiple models. Our methodology did efficiently and effectively identify conflicting terminology, omissions and system weaknesses but was inadequate for comparing the complex plan recommendations. The results re‐emphasize the importance of continual knowledge base updating, formal system testing and the need for external evaluation. The results also show the value of comparing multiple, same‐task systems.

Date: 1993
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1002/j.1099-1174.1993.tb00035.x

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wly:isacfm:v:2:y:1993:i:2:p:81-99

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=1099-1174

Access Statistics for this article

More articles in Intelligent Systems in Accounting, Finance and Management from John Wiley & Sons, Ltd.
Bibliographic data for series maintained by Wiley Content Delivery ().