 Determining the level of agreement of expert estimatesValentinas Podvezko International Journal of Management and Decision Making, 2007, vol. 8, issue 5/6, 586-600 Abstract: This paper considers the techniques of determining the concordance of expert estimates. Expert methods of evaluating particular criteria may be practically used, for instance, in multi-criteria decision support systems, if judgements are in good agreement. This is expressed by the concordance coefficient calculated by using expert-provided data. The concordance coefficient can be calculated only if the considered criteria are ranked. If other evaluation methods are used by experts, the data should be transformed to rankings before the calculation of the concordance coefficient is made. There is the dependence of the agreement of expert estimates on a particular method used. The highest degree of agreement has been obtained by using a direct ranking method. The effect of equally assessed criteria, that is, the tied ranks, on the concordance coefficient and thereby on the level of expert judgements agreement is usually insignificant and cannot change the results of rating. Keywords: expert estimates; judgement agreement; ranking; concordance coefficient; data normalisation; criteria evaluation; multicriteria decision making; MCDM; decision support systems; DSS; expert judgements. (search for similar items in EconPapers) Downloads: (external link) Related works: Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text Persistent link: https://EconPapers.repec.org/RePEc:ids:ijmdma:v:8:y:2007:i:5/6:p:586-600 Access Statistics for this article More articles in International Journal of Management and Decision Making from Inderscience Enterprises Ltd |
Is your work missing from RePEc? Here is how to contribute.
Questions or problems? Check the EconPapers FAQ or send mail to .
EconPapers is hosted by the
School of Business at Örebro University.