A decentralised multi-agent system for rail freight traffic management

Allan M. C. Bretas (), Alexandre Mendes (), Martin Jackson (), Riley Clement (), Claudio Sanhueza () and Stephan Chalup ()
Additional contact information
Allan M. C. Bretas: The University of Newcastle
Alexandre Mendes: The University of Newcastle
Martin Jackson: Hunter Valley Coal Chain Coordinator
Riley Clement: Hunter Valley Coal Chain Coordinator
Claudio Sanhueza: Hunter Valley Coal Chain Coordinator
Stephan Chalup: The University of Newcastle

Annals of Operations Research, 2023, vol. 320, issue 2, No 5, 661 pages

Abstract: Abstract The world’s largest coal export operation is located in New South Wales, Australia. The state has more than 87% of the coal transportation done through railways, and one of the strategies to increase throughput is the use of sophisticated computational techniques for rail traffic optimisation. The current state of the art shows a lack of practical applications, thus making scalability, decentralisation and real-world commitment three key research directions. Towards that, this research presents a simulation-based machine learning approach for the railway traffic management problem, in the context of the Hunter Valley Coal Chain (HVCC). We modelled trains, load points and terminals as autonomous intelligent agents that interact, learn and act independently—thus constituting a multi-agent system (MAS). The MAS is implemented on top of a rail network simulation model currently in use at the HVCC. The model is adapted as a decentralised partially-observed Markov decision process environment that allows multi-agent learning via a genetic algorithm. We present experiments with scenarios based on the actual rail network data, which show that the MAS outperforms the heuristic approach embedded in the HVCC simulation tool by up to 81% (in terms of the schedule’s total dwell time). Further to those experiments, a comparison analysis evaluates the relevance of specific state features (e.g. track length, train conflicts, etc.). Finally, an important outcome was that the agents have learned to overcome very complex traffic situations that appear in train scheduling operations and that sometimes result in unnecessarily long dwell times. This type of high level learning represents a significant step forward in the use of complex computational techniques for rail transportation problems.

Keywords: Multi-agent systems; Evolutionary algorithms; Simulation-based machine learning; Rail traffic management (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s10479-021-04178-x Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:annopr:v:320:y:2023:i:2:d:10.1007_s10479-021-04178-x

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10479

DOI: 10.1007/s10479-021-04178-x

Access Statistics for this article

Annals of Operations Research is currently edited by Endre Boros

More articles in Annals of Operations Research from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().