Sample-efficient fine-tuning with textual prompts for time series forecasting

Kaibin Wei, Jianqiang Jing, Jiawei Liu, Qing Liu and Xiannian Xie

PLOS ONE, 2026, vol. 21, issue 7, 1-18

Abstract: Time series forecasting models often face challenges in cross-domain fine-tuning, such as high training costs and limited adaptability. To address these issues, we propose a Cue-driven Feature Fusion Network (CFF-Net), which combines semantic cues from textual prompts with numerical time series features for parameter-efficient adaptation. The main idea is to use the semantic representation ability of large language models to provide auxiliary guidance, while dynamically modulating numerical predictions through scale-and-shift operations. Specifically, CFF-Net includes three main components. First, the Semantic Prompt Encoding Module (SPM) transforms numerical sequences into temporally relevant natural language descriptions, which are processed by GPT-2 to extract semantic representations. Second, the Dynamic Semantic Modulation Module (DSM) maps these semantic representations into learnable scaling (γ) and shifting (β) factors through a multi-layer perceptron, enabling modulation of PatchTST predictions within the Scale-and-Shift Feature (SSF) mechanism. Finally, a warm-start strategy is used to stabilize semantic integration during training. Experimental results on three public datasets and the TCTS dataset show that CFF-Net achieves lower errors than PatchTST in many settings, although the improvements are not uniform across all datasets and metrics. For example, on the Weather dataset, CFF-Net reduces MSE by 12.50% and 11.88% under the 30% and 20% training-sample settings, respectively. On the TCTS dataset, the corresponding MSE reductions are 5.83% and 6.60%. These results suggest that semantic prompt guidance can improve forecasting performance in several limited-data scenarios while keeping most backbone parameters fixed.

Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0353130 (text/html)
https://journals.plos.org/plosone/article/file?id= ... 53130&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pone00:0353130

DOI: 10.1371/journal.pone.0353130

Access Statistics for this article

More articles in PLOS ONE from Public Library of Science
Bibliographic data for series maintained by plosone ().