BEV-MoSeg: Segmenting Moving Objects in Bird's Eye View

Engineering notes

Key topics: autonomous driving, autonomous vehicle, bird's eye view, bev, end-to-end, motion planning, semantic segmentation, object detection, nuscenes, perception, planning. See the paper for implementation details and experimental results.

Chinese explanation / 中文解读

中文解读待补充：本站会优先为端到端自动驾驶、BEV感知、3D目标检测、轨迹预测、路径规划、LiDAR感知等高价值论文补充中文说明。

Original abstract

Accurate detection of moving objects plays a vital role in motion planning and vehicle maneuvering for autonomous vehicles. Though there is a significant improvement in perception tasks like object detection and semantic segmentation by adopting Bird's Eye View (BEV) based techniques like LiftSplatShoot, SimpleBEV etc., the moving object segmentation has gained limited attention. This research addresses this gap and propose a novel end-to-end architecture that implicitly utilizes temporal cues like optical flow in BEV space by correlation or cross-attention for moving vehicle segmentation. This work also introduces custom labels to annotate moving objects in the nuScenes dataset, enhancing its utility for the BEV motion segmentation task. We achieved an Moving Vehicle IoU Score of 26% on nuScenes dataset on full six camera rig and 22% on single front camera. The code for generating these labels and the qualitative results of our model can be found in, Project page with code: https://ajayrafa25.github.io/BEV-MoSeg/

Links and sources

• Official / arXiv page

Comments