Spatiotemporal BEV Pyramid Networks for Future Instance Prediction of Autonomous Driving

Engineering notes

Key topics: autonomous driving, autonomous vehicle, bev, occupancy, nuscenes, prediction. See the paper for implementation details and experimental results.

Chinese explanation / 中文解读

中文解读待补充：本站会优先为端到端自动驾驶、BEV感知、3D目标检测、轨迹预测、路径规划、LiDAR感知等高价值论文补充中文说明。

Original abstract

The ability to predict the future states of nearby traffic agents is critical for autonomous vehicles. Recently, it has become a new paradigm to sense and predict the future occupancy of the surrounding targets from the Bird’s Eye View (BEV) perspective, utilizing information captured by multiple cameras mounted on the vehicle. However, modeling the underlying spatiotemporal interactions between traffic agents is a challenging part. This paper proposes a novel spatiotemporal BEV pyramid network which employs Swin Transformer to extract BEV features transformed by images and predict across multiple scales. This network is designed to preserve spatial features at low resolution and capture semantic features embedded at high resolution. In addition, a Feature Alignment Module (FAM) is introduced to aggregate information at multiple scales and reduce mispredictions caused by feature misalignment. Through validation on the nuScenes dataset, the proposed method improves on the compared previous approaches in accuracy and demonstrates an enhancement in predicting the occupancy of various targets in the BEV.

Links and sources

• Official / arXiv page

Comments