A Fairness-Aware Peer-to-Peer Decentralized Learning Framework with Heterogeneous Devices

Zheyi Chen, Weixian Liao, Pu Tian, Qianlong Wang and Wei Yu
Additional contact information
Zheyi Chen: Department of Computer & Information Sciences, Towson University, Towson, MD 21252, USA
Weixian Liao: Department of Computer & Information Sciences, Towson University, Towson, MD 21252, USA
Pu Tian: Department of Computer & Information Sciences, Towson University, Towson, MD 21252, USA
Qianlong Wang: Department of Computer & Information Sciences, Towson University, Towson, MD 21252, USA
Wei Yu: Department of Computer & Information Sciences, Towson University, Towson, MD 21252, USA

Future Internet, 2022, vol. 14, issue 5, 1-18

Abstract: Distributed machine learning paradigms have benefited from the concurrent advancement of deep learning and the Internet of Things (IoT), among which federated learning is one of the most promising frameworks, where a central server collaborates with local learners to train a global model. The inherent heterogeneity of IoT devices, i.e., non-independent and identically distributed (non-i.i.d.) data, and the inconsistent communication network environment results in the bottleneck of a degraded learning performance and slow convergence. Moreover, most weight averaging-based model aggregation schemes raise learning fairness concerns. In this paper, we propose a peer-to-peer decentralized learning framework to tackle the above issues. Particularly, each local client iteratively finds a learning pair to exchange the local learning model. By doing this, multiple learning objectives are optimized to advocate for learning fairness while avoiding small-group domination. The proposed fairness-aware approach allows local clients to adaptively aggregate the received model based on the local learning performance. The experimental results demonstrate that the proposed approach is capable of significantly improving the efficacy of federated learning and outperforms the state-of-the-art schemes under real-world scenarios, including balanced-i.i.d., unbalanced-i.i.d., balanced-non.i.i.d., and unbalanced-non.i.i.d. environments.

Keywords: decentralized learning; learning fairness; heterogeneity (search for similar items in EconPapers)
JEL-codes: O3 (search for similar items in EconPapers)
Date: 2022
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1999-5903/14/5/138/pdf (application/pdf)
https://www.mdpi.com/1999-5903/14/5/138/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jftint:v:14:y:2022:i:5:p:138-:d:806847

Access Statistics for this article

Future Internet is currently edited by Ms. Grace You

More articles in Future Internet from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().