DTVAD:End-to-End Autonomous Vehicle Planning Using Reinfocement Learning

Engineering notes

Key topics: end-to-end autonomous driving, autonomous driving, autonomous vehicle, end-to-end, reinforcement learning, sim2real, nuscenes, perception, planning. See the paper for implementation details and experimental results.

Chinese explanation / 中文解读

中文解读待补充：本站会优先为端到端自动驾驶、BEV感知、3D目标检测、轨迹预测、路径规划、LiDAR感知等高价值论文补充中文说明。

Original abstract

Reinforcement learning (RL) based end-to-end autonomous driving faces significant challenges due to the sim2real gap, primarily because simulation environments are often insufficiently realistic. However, collecting data from the real world is highly risky, as RL requires exploration of potentially dangerous behaviors to learn which situations should be avoided. Additionally, the loss function of RL may hinder the optimization of the perception module. In this paper, we propose DTVAD, an RL-based end-to-end autonomous driving framework that directly leverages real-world datasets, specifically the nuScenes dataset, and employs a decision transformer as the planning module. Notably, we randomly sample 4,096 trajectories as the action space and utilize the Fréchet distance to measure the similarity between trajectories. For each sample in the nuScenes dataset, we select one of the top 70 most similar trajectories as the action for the corresponding state. The discrepancy between the selected action and the recorded trajectory may introduce potential collisions, enabling the agent to learn which behaviors should be avoided. And we use Decision Transformer(DT) as our planning head. We evaluate the effectiveness of DTVAD on the nuScenes dataset through open-loop test.

Links and sources

• Official / arXiv page

Comments