Memristor-Based Attention Network for Online Real-Time Object Tracking

Zekun Deng, Chunhua Wang, Hairong Lin, Quanli Deng, Yichuang Sun

Research output: Contribution to journalArticlepeer-review

7 Downloads (Pure)

Abstract

Most existing visual object tracking approaches are implemented based on von Neumann computation systems, which inevitably have the problems of high latency. Additionally, remote server processing of video resources requires a large amount of data transmission over the Internet, which limits real-time tracking performance. The integration of visual object tracking technology into electronic devices has become a new trend. However, current visual object tracking approaches have high algorithm complexity, making it difficult to design circuits to implement the corresponding functions. In this paper, a memristor-based attention network and its corresponding algorithm are proposed to achieve online real-time tracking under parallel computing. Memristors are used to construct attention encoding circuits to record changes of the target in historical frames, and adjust attention signals to the target online and in real-time during the tracking process, avoiding the latency problem of the von Neumann architecture. Inspired by the working process of γ-GABAergic interneuron and tripartite synapse, we propose an attention allocation module to selectively allocate attention values. Combining the Winner-Take-All principle, we design a target localization circuit and an optimal attention zone selection circuit for parallel computation to track the location of the target. Finally, experiments and analyses on OTB-100, NFS, and VOT-RTb2022 benchmark datasets verify that the proposed memristor-based attention network has promising tracking performance and achieves a tracking speed of 1000 FPS, demonstrating superior real-time performance.

Original languageEnglish
Pages (from-to)1-12
Number of pages12
JournalIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
Early online date2 Aug 2024
DOIs
Publication statusE-pub ahead of print - 2 Aug 2024

Keywords

  • Attention network
  • Encoding
  • Memristors
  • Object tracking
  • Real-time systems
  • Resource management
  • Target tracking
  • Visualization
  • allocation module
  • memristor
  • object tracking
  • online
  • real-time
  • winner-take-all

Fingerprint

Dive into the research topics of 'Memristor-Based Attention Network for Online Real-Time Object Tracking'. Together they form a unique fingerprint.

Cite this