Hierarchical coordinated control of a multi-procedure CSPS system by learning optimisation methods

Hao Tang, Chao Wang, Masayuki Matsui and Bing Liu

International Journal of Production Research, 2015, vol. 53, issue 7, 2055-2072

Abstract: We consider the hierarchical coordinated control of a multi-procedure conveyor-serviced production station system with flexible stations deployed between adjacent procedures, which includes a dynamic intra-procedure switching control of the flexible stations for the goal of balancing different procedures and a dynamic inter-procedure production coordination of all of the stations within each procedure. It is complicated in terms of modelling and optimisation, and thus, it is difficult to find a solution using numerical methods; as a result, we refer to model-free learning optimisation methods. First, we establish a neuro-dynamic programming algorithm by utilising cerebellar model articulation controllers (CMACs) to approximate state-action values at an upper hierarchy. Second, according to the reaction-diffusion phenomenon, we combine a Wolf-PHC algorithm with a local information-interaction scheme to learn look-ahead control policies at the lower hierarchy. Simulation results show that, compared with traditional Q-learning and the backward Q-learning based Q-learning, our proposed CMAC-based learning optimisation methods have the advantages of yielding a higher processing rate and having a faster optimisation speed with a lower storage requirement.

Date: 2015
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/00207543.2014.952797 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tprsxx:v:53:y:2015:i:7:p:2055-2072

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/TPRS20

DOI: 10.1080/00207543.2014.952797

Access Statistics for this article

International Journal of Production Research is currently edited by Professor A. Dolgui

More articles in International Journal of Production Research from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().