A Deep Q-Learning Network for Dynamic Constraint-Satisfied Service Composition

Xuezhi Yu, Chunyang Ye, Bingzhuo Li, Hui Zhou and Mengxing Huang
Additional contact information
Xuezhi Yu: Hainan University, Haikou, China
Chunyang Ye: Hainan University, Haikou, China
Bingzhuo Li: Hainan University, Haikou, China
Hui Zhou: Hainan University, Haikou, China
Mengxing Huang: Hainan University, Haikou, China

International Journal of Web Services Research (IJWSR), 2020, vol. 17, issue 4, 55-75

Abstract: Traditional service composition methods usually address the constraint-satisfied service composition (CSSC) problem with static web services. Such solutions however are inapplicable to the dynamic scenarios where the services or their QoS values may change over time. Some recent studies are proposed to use reinforcement learning, especially, integrate the idea of Q-learning, to solve the dynamic CSSC problem. However, such Q-learning algorithm relies on Q-table to search for optimal candidate services. When the problem of CSSC becomes complex, the number of states in Q-table is very large and the cost of the Q-learning model will become extremely high. In this paper, the authors propose a novel solution to address this issue. By training a DQN network to replace the Q-table, this solution can effectively model the uncertainty of services with fine-grained QoS attributes and choose suitable candidate services to compose on the fly in the dynamic scenarios. Experimental results on both artificial and real datasets demonstrate the effectiveness of the method.

Date: 2020
References: Add references at CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... 018/IJWSR.2020100104 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jwsr00:v:17:y:2020:i:4:p:55-75

Access Statistics for this article

International Journal of Web Services Research (IJWSR) is currently edited by Liang-Jie Zhang

More articles in International Journal of Web Services Research (IJWSR) from IGI Global
Bibliographic data for series maintained by Journal Editor ().