Design of multi-modal feedback channel of human–robot cognitive interface for teleoperation in manufacturing

Chen Zheng, Kangning Wang, Shiqi Gao, Yang Yu, Zhanxi Wang and Yunlong Tang ()
Additional contact information
Chen Zheng: Northwestern Polytechnical University
Kangning Wang: Northwestern Polytechnical University
Shiqi Gao: Northwestern Polytechnical University
Yang Yu: Northwestern Polytechnical University
Zhanxi Wang: Northwestern Polytechnical University
Yunlong Tang: Monash University

Journal of Intelligent Manufacturing, 2025, vol. 36, issue 6, No 29, 4283-4303

Abstract: Abstract Teleoperation, which is a specific mode of human–robot collaboration enabling a human operator to provide instructions and monitor the actions of the robot remotely, has proved beneficial for application to hazardous and unstructured manufacturing environments. Despite the design of a command channel from human operators to robots, most existing studies on teleoperation fail to focus on the design of the feedback channel from the robot to the human operator, which plays a crucial role in reducing the cognitive load, particularly in precise and concentrated manufacturing tasks. This paper focuses on designing a feedback channel for the cognitive interface between a human operator and a robot considering human cognition. Current studies on human–robot cognitive interfaces in robot teleoperation are extensively surveyed. Further, the modalities of human cognition that foster understanding and transparency during teleoperation are identified. In addition, the human–robot cognitive interface, which utilizes the proposed multi-modal feedback channel, is developed on a teleoperated robotic grasping system as a case study. Finally, a series of experiments based on different modal feedback channels are conducted to demonstrate the effectiveness of enhancing the performance of the teleoperated grasping of fragile products and reducing the cognitive load via the objective aspects of experimental results and the subjective aspects of operator feedback.

Keywords: Robot teleoperation; Human–robot collaboration; Multi-modal feedback channel; Human–robot cognitive interface; Cognitive load (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10845-024-02451-x Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:joinma:v:36:y:2025:i:6:d:10.1007_s10845-024-02451-x

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10845

DOI: 10.1007/s10845-024-02451-x

Access Statistics for this article

Journal of Intelligent Manufacturing is currently edited by Andrew Kusiak

More articles in Journal of Intelligent Manufacturing from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().