k -Nearest Neighbor Learning with Graph Neural Networks

Seokho Kang
Additional contact information
Seokho Kang: Department of Industrial Engineering, Sungkyunkwan University, 2066 Seobu-ro, Jangan-gu, Suwon 16419, Korea

Mathematics, 2021, vol. 9, issue 8, 1-12

Abstract: k -nearest neighbor ( k NN) is a widely used learning algorithm for supervised learning tasks. In practice, the main challenge when using k NN is its high sensitivity to its hyperparameter setting, including the number of nearest neighbors k , the distance function, and the weighting function. To improve the robustness to hyperparameters, this study presents a novel k NN learning method based on a graph neural network, named k NNGNN. Given training data, the method learns a task-specific k NN rule in an end-to-end fashion by means of a graph neural network that takes the k NN graph of an instance to predict the label of the instance. The distance and weighting functions are implicitly embedded within the graph neural network. For a query instance, the prediction is obtained by performing a k NN search from the training data to create a k NN graph and passing it through the graph neural network. The effectiveness of the proposed method is demonstrated using various benchmark datasets for classification and regression tasks.

Keywords: k -nearest neighbor; instance-based learning; graph neural network; deep learning (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2021
References: View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://www.mdpi.com/2227-7390/9/8/830/pdf (application/pdf)
https://www.mdpi.com/2227-7390/9/8/830/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:9:y:2021:i:8:p:830-:d:533723

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().