Distributed Batch Processing Architecture for Cross-Platform Abuse Detection at Scale

Hongbo Wang, Kun Qian, Chunhe Ni and Jiang Wu

Pinnacle Academic Press Proceedings Series, 2025, vol. 2, 12-27

Abstract: This paper presents a distributed batch processing architecture for cross-platform abuse detection at scale, addressing the challenges of detecting coordinated malicious activities across heterogeneous online platforms. The proposed architecture integrates platform-specific preprocessing with cross-platform feature normalization through a modular design that separates data acquisition, preprocessing, distributed processing, and result aggregation. We implement a dynamic batching strategy that optimizes computational resource utilization while maintaining detection latency within acceptable bounds. The architecture employs a multi-task learning approach with specialized deep learning models for different abuse types, leveraging platform-aware adversarial encoding to learn platform-independent representations. Performance optimization techniques including adaptive content resizing and model quantization enable efficient execution across diverse hardware environments. Experimental evaluation conducted on a dataset of 3.2 million content items from five major platforms demonstrates that our approach achieves a 12.7 % improvement in cross-platform F1-score compared to platform-specific models, while providing 2.8x higher throughput than naive cross-platform approaches. The architecture's ability to identify coordinated abuse campaigns spanning multiple platforms highlights the value of integrated cross-platform analysis in detecting sophisticated abuse patterns. The implementation successfully balances detection accuracy, processing efficiency, and scalability requirements, providing an effective solution for large-scale abuse detection across diverse online environments.

Keywords: distributed processing; abuse detection; cross-platform analysis; deep learning (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://pinnaclepubs.com/index.php/PAPPS/article/view/89/88 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:dba:pappsa:v:2:y:2025:i::p:12-27

Access Statistics for this article

More articles in Pinnacle Academic Press Proceedings Series from Pinnacle Academic Press
Bibliographic data for series maintained by Joseph Clark ().