Dynamic Adaptive Mechanism Design and Implementation in VSS for Large-Scale Unified Log Data Collection

Zhijie Fan, Bo Yang, Jing Peng, Bingsen Pei, Changsong Zheng and Xin Li
Additional contact information
Zhijie Fan: Shanghai Chenrui Information Technology Company, China
Bo Yang: Chinese Academy of Sciences, China
Jing Peng: Sichuan Provincial Public Security Department, China
Bingsen Pei: People's Public Security University of China, China
Changsong Zheng: Sichuan Provincial Public Security Department, China
Xin Li: People's Public Security University of China, China

International Journal of Information Security and Privacy (IJISP), 2024, vol. 18, issue 1, 1-26

Abstract: This paper studies the collection of large-scale log data of information system and puts forward a dynamic adaptive mechanism for large-scale unified log data collection. Furthermore, we design and implement our method for pan-government industry safety operation management platform. The data flow processing architecture based on message queue is adopted to realize the decoupling of log collection, log processing and log reporting. The traffic peak clipping technology of message queue is adopted to ensure the safety and reliability of log transmission. According to the characteristics of log traffic, a design mode supporting dynamic adjustment of consumption group is proposed to meet the high-performance requirements of the system. The whole system can meet the centralized analysis, security threat perception and intelligent analysis of various security data. Meanwhile, we analyzed and compared with the traditional open-source log collection technology, our proposed method and system has clear advantages.

Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve.aspx?doi=10.4018/IJISP.349569 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jisp00:v:18:y:2024:i:1:p:1-26

Access Statistics for this article

International Journal of Information Security and Privacy (IJISP) is currently edited by Yassine Maleh

More articles in International Journal of Information Security and Privacy (IJISP) from IGI Global
Bibliographic data for series maintained by Journal Editor ().