Open-World Critical Scenario Recognition and Maneuver-Level Generation for Autonomous Driving Simulation Testing

Engineering notes

Key topics: autonomous driving, carla, real-world driving, deployment, control. See the paper for implementation details and experimental results.

Chinese explanation / 中文解读

中文解读待补充：本站会优先为端到端自动驾驶、BEV感知、3D目标检测、轨迹预测、路径规划、LiDAR感知等高价值论文补充中文说明。

Original abstract

As autonomous driving moves toward large-scale deployment, controllable and efficient simulation testing has become a primary means of ensuring system safety. However, in open-world environments, existing scenario catalogs often fail to cover the full spectrum of potential traffic situations, while rare yet high-risk critical scenarios are even harder to obtain. This scarcity renders traditional random sampling and parameter-sweeping strategies ineffective for identifying unknown risks. This study addresses two core challenges: (1) incomplete scenario catalogs hindering unknown critical scenario recognition and (2) insufficient critical samples, where generated scenarios struggle to balance physical realism and edge case coverage. To tackle the first challenge, we propose an open-world recognition method integrating transformers, random forests, and extreme value theory for precise unseen sample detection. Outlier and validity filtering ensure clustering reliability, and random forest activation patterns cluster unknown samples into meaningful groups to expand the scenario catalog. Experiments show the overall F1_macro improved by 2.3 percentage points over SOTA MDENet, with its clustering accuracy surpassing iterative-AutoNovel by 6.2 percentage points. For the second challenge, we introduce a reinforcement-learning-based maneuver-level generation method. It extracts maneuver semantics from trajectories, constructs a low-dimensional parameter space, and models parameter correlations via a multivariate multimodal distribution. A dual-layer LSTM agent with a composite reward iteratively optimizes policies toward high-risk edge scenarios. The results outperformed RLBE; longitudinal and lateral reconstruction errors were reduced by 32.7% and 15.3%, respectively, while high-risk time steps and the collision rate increased by 4.3% and 5.1%, respectively. Finally, we develop a CARLA-based scenario-driven simulation framework, integrating recognized and generated scenarios into closed-loop testing on high-risk road segments. CAS failure cases validate the generated scenarios’ physical feasibility and extreme challenge. Targeted augmentation of scarce critical scenarios enriches the test library and ensures broader coverage of real-world driving conditions.

Links and sources

Comments