arXiv new; ViT attention/object-centric robustness · P2 · 2026-07-16
Inhibited Self-Attention：它和通用视觉自监督的关系在于：利用负注意力抑制背景响应，提升 ViT object-centric selectivity 与 OOD robustness
中高相关；详见方法、贡献和实验边界。
Inhibited Self-Attention: Sharpening Focus in Vision Transformers arXiv new; ViT attention/object-centric robustness 原文链接
编号2607.12881优先级P2类别arXiv new; ViT attention/object-centric robustness会议arXiv new; ViT attention/object-centric robustness方法利用负注意力抑制背景响应，提升 ViT object-centric selectivity 与 OOD robustness来源arXiv / OpenReview
先说结论。它和通用视觉自监督的关系在于：利用负注意力抑制背景响应，提升 ViT object-centric selectivity 与 OOD robustness。 中高相关；详见方法、贡献和实验边界。
(b) Comparison of softmax, softmin, and inhibited attention maps (α = 1.8) Figure 2(b) Comparison of softmax, softmin, and inhibited attention maps (α = 1.8) Figure 2. A (a) schematic overview of the Inhibited Self-Attention, and (b) example images alongside their attention maps for softmax (conventional Self-Attention), softmin, and our Inhibited Self-Attention (ISA).这张图概括 Inhibited Self-Attention 的整体方法流程。阅读时先看模块之间传递的训练信号，再看作者如何把目标拆成可优化的子问题。(b) ISA-ViT-S/16 Figure 1(b) ISA-ViT-S/16 Figure 1. (a) Examples of correctly classified images by a ViT-S/16 with very high confidence where the attention of the model is not directed at the object of interest. (b) The same images classified by ISA-ViT-S/16 using our proposed inhibited self-attention.这张可视化用来解释 Inhibited Self-Attention 学到的中间表征或对齐关系。重点看它是否支持正文里的机制判断。
核心问题
它和通用视觉自监督的关系在于：利用负注意力抑制背景响应，提升 ViT object-centric selectivity 与 OOD robustness。
方法拆解
利用负注意力抑制背景响应，提升 ViT object-centric selectivity 与 OOD robustness
