Robustness Enhancement of Neural Networks via Architecture Search with Multi-Objective Evolutionary Optimization

Haojie Chen, Hai Huang, Xingquan Zuo and Xinchao Zhao
Additional contact information
Haojie Chen: School of Computer Science, Beijing University of Posts and Telecommunications, Beijing 100876, China
Hai Huang: School of Computer Science, Beijing University of Posts and Telecommunications, Beijing 100876, China
Xingquan Zuo: School of Computer Science, Beijing University of Posts and Telecommunications, Beijing 100876, China
Xinchao Zhao: School of Science, Beijing University of Posts and Telecommunications, Beijing 100876, China

Mathematics, 2022, vol. 10, issue 15, 1-15

Abstract: Along with the wide use of deep learning technology, its security issues have drawn much attention over the years. Adversarial examples expose the inherent vulnerability of deep learning models and make it a challenging task to improve their robustness. Model robustness is related not only to its parameters but also to its architecture. This paper proposes a novel robustness enhanced approach for neural networks based on a neural architecture search. First, we randomly sample multiple neural networks to construct the initial population. Second, we utilize the individual networks in the population to fit and update the surrogate models. Third, the population of neural networks is evolved through a multi-objective evolutionary algorithm, where the surrogate models accelerate the performance evaluation of networks. Finally, the second and third steps are performed alternately until a network architecture with high accuracy and robustness is achieved. Experimental results show that the proposed method outperforms some classical artificially designed neural networks and other architecture search algorithms in terms of robustness.

Keywords: neural architecture search; surrogate model; CLEVER score; adversarial defense (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2022
References: View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.mdpi.com/2227-7390/10/15/2724/pdf (application/pdf)
https://www.mdpi.com/2227-7390/10/15/2724/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:10:y:2022:i:15:p:2724-:d:878116

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().