Measuring patients’ priorities using the Analytic Hierarchy Process in comparison with Best-Worst-Scaling and rating cards: methodological aspects and ranking tasks

Katharina Schmidt (), Ana Babac (), Frédéric Pauer (), Kathrin Damm () and Johann Graf von der Schulenburg
Additional contact information
Katharina Schmidt: Leibniz University of Hannover
Ana Babac: Leibniz University of Hannover
Frédéric Pauer: Leibniz University of Hannover
Kathrin Damm: Leibniz University of Hannover

Health Economics Review, 2016, vol. 6, issue 1, 1-11

Abstract: Abstract Background Identifying patient priorities and preference measurements have gained importance as patients claim a more active role in health care decision making. Due to the variety of existing methods, it is challenging to define an appropriate method for each decision problem. This study demonstrates the impact of the non-standardized Analytic Hierarchy Process (AHP) method on priorities, and compares it with Best-Worst-Scaling (BWS) and ranking card methods. Methods We investigated AHP results for different Consistency Ratio (CR) thresholds, aggregation methods, and sensitivity analyses. We also compared criteria rankings of AHP with BWS and ranking cards results by Kendall’s tau b. Results The sample for our decision analysis consisted of 39 patients with rare diseases and mean age of 53.82 years. The mean weights of the two groups of CR ≤ 0.1 and CR ≤ 0.2 did not differ significantly. For the aggregation by individual priority (AIP) method, the CR was higher than for aggregation by individual judgment (AIJ). In contrast, the weights of AIJ were similar compared to AIP, but some criteria’s rankings differed. Weights aggregated by geometric mean, median, and mean showed deviating results and rank reversals. Sensitivity analyses showed instable rankings. Moderate to high correlations between the rankings resulting from AHP and BWS. Limitations Limitations were the small sample size and the heterogeneity of the patients with different rare diseases. Conclusion In the AHP method, the number of included patients is associated with the threshold of the CR and choice of the aggregation method, whereas both directions of influence could be demonstrated. Therefore, it is important to implement standards for the AHP method. The choice of method should depend on the trade-off between the burden for participants and possibilities for analyses.

Keywords: Decision making; Analytic Hierarchy Process; Best-worst-scaling; Method comparison; Patient preferences (search for similar items in EconPapers)
Date: 2016
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://link.springer.com/10.1186/s13561-016-0130-6 Abstract (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:hecrev:v:6:y:2016:i:1:d:10.1186_s13561-016-0130-6

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/13561

DOI: 10.1186/s13561-016-0130-6

Access Statistics for this article

Health Economics Review is currently edited by J. Matthias Graf von der Schulenburg

More articles in Health Economics Review from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().