A Communication-Efficient Federated Text Classification Method Based on Parameter Pruning

Zheng Huo, Yilin Fan () and Yaxin Huang
Additional contact information
Zheng Huo: Information Technology School, Hebei University of Economics and Business, Shijiazhuang 050061, China
Yilin Fan: Information Technology School, Hebei University of Economics and Business, Shijiazhuang 050061, China
Yaxin Huang: Information Technology School, Hebei University of Economics and Business, Shijiazhuang 050061, China

Mathematics, 2023, vol. 11, issue 13, 1-13

Abstract: Text classification is an important application of machine learning. This paper proposes a communication-efficient federated text classification method based on parameter pruning. In the federated learning architecture, the data distribution of different participants is not independent and identically distributed; a federated word embedding model FedW2V is proposed. Then the TextCNN model is extended to the federated architecture. To reduce the communication cost of the federated TextCNN model, a parameter pruning algorithm called FedInitPrune is proposed, which reduces the amount of communication data both in the uplink and downlink during the parameter transmission phase. The algorithms are tested on real-world datasets. The experimental results show that when the text classification model accuracy reduces by less than 2%, the amount of federated learning communication parameters can be reduced by 74.26%.

Keywords: federated learning; parameter pruning; text classification; TextCNN (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/11/13/2804/pdf (application/pdf)
https://www.mdpi.com/2227-7390/11/13/2804/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:11:y:2023:i:13:p:2804-:d:1176543

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().