Prototype-Based Two-Stage Few-Shot Instance Segmentation with Flexible Novel Class Adaptation

Qinying Zhu, Yilin Zhang (), Peng Xiao (), Mengxi Ying, Lei Zhu and Chengyuan Zhang
Additional contact information
Qinying Zhu: College of Information and Intelligence, Hunan Agricultural University, Changsha 410128, China
Yilin Zhang: College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, China
Peng Xiao: School of Computer, Hunan University of Technology, Zhuzhou 412007, China
Mengxi Ying: School of Computer, Hunan University of Technology, Zhuzhou 412007, China
Lei Zhu: College of Information and Intelligence, Hunan Agricultural University, Changsha 410128, China
Chengyuan Zhang: College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, China

Mathematics, 2025, vol. 13, issue 17, 1-17

Abstract: Few-shot instance segmentation (FSIS) is devised to address the intricate challenge of instance segmentation when labeled data for novel classes is scant. Nevertheless, existing methodologies encounter notable constraints in the agile expansion of novel classes and the management of memory overhead. The integration workflow for novel classes is inflexible, and given the necessity of retaining class exemplars during both training and inference stages, considerable memory consumption ensues. To surmount these challenges, this study introduces an innovative framework encompassing a two-stage “base training-novel class fine-tuning” paradigm. It acquires discriminative instance-level embedding representations. Concretely, instance embeddings are aggregated into class prototypes, and the storage of embedding vectors as opposed to images inherently mitigates the issue of memory overload. Via a Region of Interest (RoI)-level cosine similarity matching mechanism, the flexible augmentation of novel classes is realized, devoid of the requirement for supplementary training and independent of historical data. Experimental validations attest that this approach significantly outperforms state-of-the-art techniques in mainstream benchmark evaluations. More crucially, its memory-optimized attributes facilitate, for the first time, the conjoint assessment of FSIS performance across all classes within the COCO dataset. Visualized instances (incorporating colored masks and class annotations of objects across diverse scenarios) further substantiate the efficacy of the method in real-world complex contexts.

Keywords: few-shot instance segmentation; incremental learning; embedding representation; memory optimization (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2025
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/13/17/2889/pdf (application/pdf)
https://www.mdpi.com/2227-7390/13/17/2889/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:13:y:2025:i:17:p:2889-:d:1744264

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().