Enhanced saliency prediction via free energy principle

Publication Type:
Conference Proceeding
Communications in Computer and Information Science, 2019, 1009 pp. 31 - 44
Issue Date:
Filename Description Size
Symplectic CV_Promotions.pdfPublished version447.2 kB
Adobe PDF
Full metadata record
© Springer Nature Singapore Pte Ltd 2019. Saliency prediction can be treated as the activity of human brain. Most saliency prediction methods employ features to determine the contrast of an image area relative to its surroundings. However, only few studies have investigated how human brain activities affect saliency prediction. In this paper, we propose an enhanced saliency prediction model via free energy principle. A new AR-RTV model, which combines the relative total variation (RTV) structure extractor with autoregressive (AR) operator, is firstly utilized to decompose an original image into the predictable component and the surprise component. Then, we adopt the local entropy of ‘surprise’ map and the gradient magnitude (GM) map to estimate the component saliency maps-sub-saliency respectively. Finally, inspired by visual error sensitivity, a saliency augment operator is designed to enhance the final saliency combined two sub-saliency maps. Experimental results on two benchmark databases demonstrate the superior performance of the proposed method compared to eleven state-of-the-art algorithms.
Please use this identifier to cite or link to this item: