Exploiting Surroundedness for Saliency Detection: A Boolean Map Approach 

Jianming Zhang         Stan Sclaroff

pipeline

We demonstrate the usefulness of surroundedness for eye fixation prediction by proposing a Boolean Map based Saliency model (BMS). In our formulation, an image is characterized by a set of binary images, which are generated by randomly thresholding the image's feature maps in a whitened feature space. Based on a Gestalt principle of figure-ground segregation, BMS computes a saliency map by discovering surrounded regions via topological analysis of Boolean maps. The strength of BMS is verified by its simplicity, efficiency and superior performance compared with ten state-of-the-art methods on seven eye tracking benchmark datasets. 

Publications

[1] Jianming Zhang and Stan Sclaroff. "Saliency Detection: A Boolean Map Approach.'' In Proc. IEEE Internetional Conference on Computer Vision (ICCV), 2013. [PDF] [Supplementary Materials] (more examples of saliency maps)

[2] Jianming Zhang and Stan Sclaroff. "Exploiting Surroundedness for Saliency Detection: A Boolean Map Approach.'' IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2015. [PDF] [Supplementary Materials]  **New**


Shuffled-AUC against Guassian Blur STD (reported in [2])

sAUC
The green line presents the improved version of BMS described in [2], and the red dashed line represents the previous version described in [1]. We re-evaluated all the methods in [2] using the updated implementaion of Shuffled-AUC (provided below). We also tuned the compared methods for better performance. Note that the Judd's model uses object detectors, which were disabled in the evaluation of [1], but in [2] the scores of the full implementation of Judd's model are reported. All these changes account for the differences between the scores reported in [1] and in [2].



Downloads

(a) Materials Accompanying the ICCV Paper

We provide two versions of code. They have been tested on Windows system, with Matlab 2011+ and OpenCV2.40+. They are essentially the same but need to be compiled differently (detailed instructions included). Usually, either of them should work on your computers, but the EXE version can run without Matlab.

Soure Code: [Mex + Matlab] [EXE + Matlab Wrapper]
Precomputed Saliency Maps: [BMS] [Other Models]


(b) Materials Accompanying the Journal version **NEW**

This implementation of BMS is only for eye fixation prediction. It is more accurate and faster than the previous version. Under the default configuration, it runs at about 11fps. It can be configured to run at about 100fps with only a slight drop in performance. 

Source Code: [Mex + Matlab] [EXE + Matlab Wrapper]


(c) Evaluation **NEW**

We provide an improved implementation of shuffle-AUC. We also provide the postprocess code if you are interested in evaluating our method in any metric that does not control center bias. e.g. AUC, Similarity.

Code for Shuffled-AUC: [Matlab] (More precise shuffling than other versions.)
Postprocess Code for AUC: [Matlab] (Do not use this postprocess code if shuffled-AUC is used.)
Users of our code are asked to cite the following publications:

@inproceedings{zhang2013saliency,
title={saliency detection: a {B}oolean map approach},
author={Zhang, Jianming and Sclaroff, Stan},
booktitle={Proc. of the IEEE International Conference on Computer Vision (ICCV)},
year={2013}
}

@article{zhang2015exploiting,
title={Exploiting surroundedness for saliency detection: a {B}oolean map approach},
author={Zhang, Jianming and Sclaroff, Stan},
journal={IEEE Trans. Pattern Anlaysis and Machine Intellegence (TPAMI)},
year={2015}
}
sample