  How to effectively fuse cross-modal information is the key problem for RGB-D
salient object detection. Early fusion and the result fusion schemes fuse RGB
and depth information at the input and output stages, respectively, hence incur
the problem of distribution gap or information loss. Many models use the
feature fusion strategy but are limited by the low-order point-to-point fusion
methods. In this paper, we propose a novel mutual attention model by fusing
attention and contexts from different modalities. We use the non-local
attention of one modality to propagate long-range contextual dependencies for
the other modality, thus leveraging complementary attention cues to perform
high-order and trilinear cross-modal interaction. We also propose to induce
contrast inference from the mutual attention and obtain a unified model.
Considering low-quality depth data may detriment the model performance, we
further propose selective attention to reweight the added depth cues. We embed
the proposed modules in a two-stream CNN for RGB-D SOD. Experimental results
have demonstrated the effectiveness of our proposed model. Moreover, we also
construct a new challenging large-scale RGB-D SOD dataset with high-quality,
thus can both promote the training and evaluation of deep models.
