Learn the interactions: Weakly supervised video anomaly detection with human-object interactions

Maowen Zhou, Erma Rahayu Mohd Faizal Abdullah, Aznul Qalid Md Sabri and Susanto Rahardja

PLOS ONE, 2026, vol. 21, issue 9, 1-23

Abstract: Weakly supervised video anomaly detection remains a challenging problem, primarily due to the scarcity of abnormal training samples and the lack of diverse feature representations, which hamper the learning of discriminative models. To address these issues, we introduce a novel weakly supervised cross-domain framework that enriches feature representations by explicitly integrating semantic cues from Human-Object Interactions (HOI) and action dynamics. Specifically, we model domain-specific features using two independent encoders and fuse them via a bi-directional cross-attention mechanism to obtain a unified embedding. To further alleviate class imbalance and enhance feature discrimination, our network is jointly optimized with classification loss, a cross-domain contrastive loss, and a clip-level focal loss. The proposed method is evaluated with various visual backbones, demonstrating its adaptability and robustness. Extensive experiments show that our approach achieves competitive performance against state-of-the-art methods under weak supervision in terms of AUC. Specifically, our proposed method achieves 98.33% AUC and 87.96% AUC on two benchmark datasets, i.e., ShanghaiTech and UCF-Crime, respectively.

Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0358538 (text/html)
https://journals.plos.org/plosone/article/file?id= ... 58538&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pone00:0358538

DOI: 10.1371/journal.pone.0358538

Access Statistics for this article

More articles in PLOS ONE from Public Library of Science
Bibliographic data for series maintained by plosone ().