Task-Covariant Representations for Few-Shot Learning on Remote Sensing Images

Liyi Zhang, Zengguang Tian, Yi Tang () and Zuo Jiang ()
Additional contact information
Liyi Zhang: School of Mathematics and Computer Science, Yunnan Minzu University, Kunming 650500, China
Zengguang Tian: School of Mathematics and Computer Science, Yunnan Minzu University, Kunming 650500, China
Yi Tang: School of Mathematics and Computer Science, Yunnan Minzu University, Kunming 650500, China
Zuo Jiang: School of Mathematics and Computer Science, Yunnan Minzu University, Kunming 650500, China

Mathematics, 2023, vol. 11, issue 8, 1-19

Abstract: In the regression and classification of remotely sensed images through meta-learning, techniques exploit task-invariant information to quickly adapt to new tasks with fewer gradient updates. Despite its usefulness, task-invariant information alone may not effectively capture task-specific knowledge, leading to reduced model performance on new tasks. As a result, the concept of task-covariance has gained significant attention from researchers. We propose task-covariant representations for few-shot Learning on remote sensing images that utilizes capsule networks to effectively represent the covariance relationships among objects. This approach is motivated by the superior ability of capsule networks to capture such relationships. To capture and leverage the covariance relations between tasks, we employ vector capsules and adapt our model parameters based on the newly learned task covariance relations. Our proposed meta-learning algorithm offers a novel approach to effectively address the real task distribution by incorporating both general and specific task information. Based on the experimental results, our proposed meta-learning algorithm shows a significant improvement in both the average accuracy and training efficiency compared to the best model in the experiments. On average, the algorithm increases the accuracy by approximately 4% and improves the training efficiency by approximately 8%.

Keywords: capsule network; meta-learning; subspace learning; covariance (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/11/8/1930/pdf (application/pdf)
https://www.mdpi.com/2227-7390/11/8/1930/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:11:y:2023:i:8:p:1930-:d:1127743

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().