Compilation of Experimental Price Indices Using Big Data and Machine Learning:A Comparative Analysis and Validity Verification of Quality Adjustments

Nobuhiro Abe and Kimiaki Shinozaki
Additional contact information
Nobuhiro Abe: Bank of Japan
Kimiaki Shinozaki: Bank of Japan

No 18-E-13, Bank of Japan Working Paper Series from Bank of Japan

Abstract: This paper compiles experimental price indices for 20 home electrical appliances and digital consumer electronic products using big data obtained from Kakaku.com, the largest price comparison website in Japan, and a machine-learning algorithm which pairs legacy and successor products with high precision. In so doing, authors examine the validity of quality adjustment methods by performing comparative analyses on the difference these methods have on price indices. Findings from the analyses are as follows: Indices applied with the Webscraped Prices Comparison Method--the quality adjustment method newly developed and introduced by the Bank of Japan--are more cost-effective than those applied with the Hedonic Regression Method which is known to possess high accuracy in index creation. Indices applied with the Matched-Model Method, which is frequently applied to price indices using big data is unable to precisely reflect price increases intended to ensure the profitability often seen in home electronics at time of product turnover. This indicates the significant downward bias in price indices. These findings once again highlight the importance of selecting the appropriate quality adjustment method when compiling price indices.

Keywords: price index; quality adjustment method; hedonic approach; support vector machine (search for similar items in EconPapers)
JEL-codes: C43 C45 E31 (search for similar items in EconPapers)
Date: 2018-08-20
New Economics Papers: this item is included in nep-big, nep-cmp, nep-ict and nep-pay
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://www.boj.or.jp/en/research/wps_rev/wps_2018/data/wp18e13.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:boj:bojwps:wp18e13

Access Statistics for this paper

More papers in Bank of Japan Working Paper Series from Bank of Japan Contact information at EDIRC.
Bibliographic data for series maintained by Bank of Japan ().