Verification of Uncertain Knowledge-Based Systems: An Empirical Verification Approach

Daniel O'Leary

Management Science, 1996, vol. 42, issue 12, 1663-1675

Abstract: A number of different tests and approaches are developed to determine the existence of potential anomalies in rule-based systems that employ MYCIN uncertainty factors (weights). First, the distribution of weights is compared to other systems' distributions and weights are investigated as to their individual meanings, to determine whether any weights are unusual. Second, there is increasing evidence that people are not "good" at developing weights on rules, building in symmetries and redundancies that signal "usual" assumptions about the underlying probabilities. Accordingly, weight symmetries generated from rule pairs are analyzed to determine the existence of anomalies. Third, typically rule-based tools have been developed for application in specific domains, such as medicine. Unique aspects of those domains may limit application of the tools to other domains. Finally, ad hoc, rule-based approaches are suboptimal, and alternative formal probability approaches, such as Bayes' nets, more fully specify the probabilistic nature of knowledge. The paper is part of the empirical verification literature, where verification is done on an actual system and the system provides data that indicates the kinds of anomalies that can be expected. A case study is used to illustrate each of the verification tests and concerns.

Keywords: knowledge-based systems; expert systems; uncertainty in AI; verification and validation (search for similar items in EconPapers)
Date: 1996
References: Add references at CitEc
Citations:

Downloads: (external link)
http://dx.doi.org/10.1287/mnsc.42.12.1663 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:ormnsc:v:42:y:1996:i:12:p:1663-1675

Access Statistics for this article

More articles in Management Science from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().