Occlusion-aware visual object tracking with explicit temporal state modeling and dual-memory mechanismShow others and affiliations
2026 (English)In: Pattern Recognition, ISSN 0031-3203, E-ISSN 1873-5142, Vol. 180, article id 114155Article in journal (Refereed) Published
Abstract [en]
Visual Object Tracking (VOT) remains challenging under occlusion scenarios, where traditional trackers often suffer from feature degradation and target loss. To address this issue, we propose OASAMT, an occlusion-aware tracking framework that equips SAM2 with explicit temporal occlusion reasoning via two Temporal Convolutional Networks (TCNs) and a Dual-Memory Bank (DMB). Specifically, two TCN-based modules are designed to model temporal occlusion dynamics: the Temporal Occlusion Classifier (TOC) for inferring target occlusion states using confidence scores, mask IoU, and area ratio; and the Temporal Occlusion Predictor (TOP) for forecasting target bounding boxes during occlusion. The proposed DMB consists of a Non-Occlusion Memory Bank (N-OMB) and an Occlusion Memory Bank (OMB), explicitly decoupling reliable and occluded representations to prevent memory contamination and improve re-detection after occlusion. Additionally, to facilitate systematic evaluation under occlusion scenarios, we construct OccTrack, a dedicated occlusion-oriented dataset derived from four UAV-view benchmarks. Extensive experiments were conducted on the OccTrack, LaSOT, LaSOText, and GOT-10k datasets. The results demonstrate that OASAMT consistently outperforms SAM2.1 and other advanced trackers in both occlusion-specific and general tracking scenarios. The code and the dataset are available at https://github.com/ChaseFalcon99/OASAMT.
Place, publisher, year, edition, pages
Elsevier BV , 2026. Vol. 180, article id 114155
Keywords [en]
Visual object tracking, Segment Anything Model 2, Temporal Convolutional Networks, Dual-memory bank, Occlusion handling
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-386782DOI: 10.1016/j.patcog.2026.114155ISI: 001798983600001Scopus ID: 2-s2.0-105041537681OAI: oai:DiVA.org:kth-386782DiVA, id: diva2:2090893
Note
QC 20260810
2026-08-102026-08-102026-08-10Bibliographically approved