Adaptive token division-based transformer for visual object tracking

Engineering notes

Finally, we conduct tests on six tracking benchmarks, and the experimental results prove the effectiveness of our method.

Chinese explanation / 中文解读

中文解读待补充：本站会优先为端到端自动驾驶、BEV感知、3D目标检测、轨迹预测、路径规划、LiDAR感知等高价值论文补充中文说明。

Original abstract

In visual object tracking, one-stream trackers typically use all search tokens to interact with templates across all encoder layers. However, the search area usually contains a lot of interference information, such as distractors with similar appearance to the tracking object, which will cause the distractors in the search area to be misjudged as interactive objects, establish wrong cross-relation modeling, and reduce the accuracy of tracking. To alleviate this issue, this paper proposes a transformer-based visual object tracking framework with adaptive token division. First, our tracking framework is a simple encoder-decoder structure without any post-processing. Second, we propose an adaptive token division module, which enables search tokens and template tokens to perform the most appropriate cross-relationship modeling, and improves the model 's ability to distinguish between object and background. At the same time, we introduce an attention masking strategy and Gumbel-Softmax technique. The strategy enables efficient and parallel attention calculation between different categories of tokens, and the technique facilitates the end-to-end optimization of the division module. Finally, we conduct tests on six tracking benchmarks, and the experimental results prove the effectiveness of our method.

Links and sources

• PDF from original source

Comments