Benchmarking Perception to Streaming Inputs in Vision-Centric Autonomous Driving

Tianshi Jin, Weiping Ding (), Mingliang Yang, Honglin Zhu and Peisong Dai
Additional contact information
Tianshi Jin: School of Mechanical Engineering, Southwest Jiaotong University, Chengdu 610031, China
Weiping Ding: School of Mechanical Engineering, Southwest Jiaotong University, Chengdu 610031, China
Mingliang Yang: School of Mechanical Engineering, Southwest Jiaotong University, Chengdu 610031, China
Honglin Zhu: School of Mechanical Engineering, Southwest Jiaotong University, Chengdu 610031, China
Peisong Dai: School of Mechanical Engineering, Southwest Jiaotong University, Chengdu 610031, China

Mathematics, 2023, vol. 11, issue 24, 1-19

Abstract: In recent years, vision-centric perception has played a crucial role in autonomous driving tasks, encompassing functions such as 3D detection, map construction, and motion forecasting. However, the deployment of vision-centric approaches in practical scenarios is hindered by substantial latency, often deviating significantly from the outcomes achieved through offline training. This disparity arises from the fact that conventional benchmarks for autonomous driving perception predominantly conduct offline evaluations, thereby largely overlooking the latency concerns prevalent in real-world deployment. Although a few benchmarks have been proposed to address this limitation by introducing effective evaluation methods for online perception, they do not adequately consider the intricacies introduced by the complexity of input information streams. To address this gap, we propose the Autonomous driving Streaming I/O (ASIO) benchmark, aiming to assess the streaming input characteristics and online performance of vision-centric perception in autonomous driving. To facilitate this evaluation across diverse streaming inputs, we initially establish a dataset based on the CARLA Leaderboard. In alignment with real-world deployment considerations, we further develop evaluation metrics based on information complexity specifically tailored for streaming inputs and streaming performance. Experimental results indicate significant variations in model performance and ranking under different major camera deployments, underscoring the necessity of thoroughly accounting for the influences of model latency and streaming input characteristics during real-world deployment. To enhance streaming performance consistently across distinct streaming input features, we introduce a backbone switcher based on the identified streaming input characteristics. Experimental validation demonstrates its efficacy in perpetually improving streaming performance across varying streaming input features.

Keywords: vison-centric perception benchmark; online assessment; streaming inputs; two-dimensional entropy (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/11/24/4976/pdf (application/pdf)
https://www.mdpi.com/2227-7390/11/24/4976/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:11:y:2023:i:24:p:4976-:d:1301569

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().