A constraint partially observable semi-Markov decision process for the attack–defence relationships in various critical infrastructures

Nadia Niknami and Jie Wu

Cyber-Physical Systems, 2022, vol. 8, issue 2, 85-110

Abstract: Gaining a better understanding of the relationship between attackers and defenders in cybersecurity domains to protect computer systems is of great importance. From the defender’s side, it is critical to choose the best reaction to maintain the system in a safe state, based on a given estimate of the attacker. One of the main challenges is that the defender may not be able to correctly detect a current attack due to incomplete and noisy information . Another important factor in the attack-defence interaction is the limited budget of both attackers and defenders. . This paper focuses on an approach based on interactions between the attacker and defender by considering the problem of uncertainty and limitation of resources for the defender, given that the attacker’s actions are given in all states of a Markov chain. The best actions by the defender can be characterised by a Markov Decision Process in the case of partial observability and importance of time in the expected reward, which is a Partially Observable Semi-Markov Decision model. Our simulation on a trace-based data set demonstrates that the proposed approach handles analysing interactions of the attacker and defender with limited budgets foralong with imperfect information for the defender.

Date: 2022
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/23335777.2021.1879935 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tcybxx:v:8:y:2022:i:2:p:85-110

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/tcyb20

DOI: 10.1080/23335777.2021.1879935

Access Statistics for this article

Cyber-Physical Systems is currently edited by Yang Xiao

More articles in Cyber-Physical Systems from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().