close
Skip to main content
Springer Nature Link
Log in

A Multiple Graph Label Propagation Integration Framework for Salient Object Detection

  • Published:
Save article
View saved research
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Saliency prediction typically relies on multiple features that are combined in the ways of weighted summation or multiplication to form a saliency map, which is heuristic and hard for generalization. In this paper, a novel multiple graph label propagation integration framework for saliency object detection algorithm is proposed. The proposed algorithm is divided into four steps. First, an input image is segmented into superpixels which are represented as nodes in a graph and transformed from RGB color space into CIE L*a*b* color space. Second, combined by texture features, we measure the similarity of two adjacent superpixels for each feature, which is represented as an affinity matrix. Then, to generate the salient seeds, we adopt the color boosting Harris points as salient points to catch the corners or marginal points of visual salient region in color image. The saliency points provide us a coarse location of the salient areas. In the last step, the graphs are combined into label propagation framework to obtain the saliency maps. We propose efficient optimization algorithms for the proposed approach, which generate sparse weighted coefficients that allow identifying the graphs which are important or not for salient object detection easily. Experiments on four benchmark databases demonstrate the proposed method performs well when it violates the state-of-the-art methods in terms of accuracy and robustness.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+
from $39.99 /Month
  • Starting from 10 chapters or articles per month
  • Access and download chapters and articles from more than 300k books and 2,500 journals
  • Cancel anytime
View plans

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Explore related subjects

Discover the latest articles, books and news in related subjects, suggested using machine learning.

References

  1. Santella A, Agrawala M, DeCarlo D, Salesin D, Cohen M (2006) Gaze-based interaction for semi-automatic photo cropping. In: Proceedings of the SIGCHI conference human factors in computing systems, pp. 771–780

  2. Chen L, Xie X, Fan X et al (2003) A visual attention model for adapting images on small displays. Multimed Syst 9(4):353–364

    Article  Google Scholar 

  3. Guo C, Zhang L (2010) A novel multiresolution spatiotemporal saliency detection model and its applications in image and video compression. IEEE Trans Image Process 19(1):185–198

    Article  MathSciNet  Google Scholar 

  4. Navalpakkam V, Itti L (2006) An integrated model of top-down and bottom-up attention for optimizing detection speed. In: Proceedings of the international conference on computer vision and pattern recognition, vol. 2, pp. 2049–2056

  5. Rutishauser U, Walther D, Koch C, Perona P (2004) Is bottom-up attention useful for object recognition? In: Proceedings of the international conference on computer vision and pattern recognition, vol. 2, pp. 37–44

  6. Itti L (2000) Models of bottom-up and top-down visual attention. PhD thesis, California Institute of Technology Pasadena

  7. Kanan C, Tong MH, Zhang L, Cottrell GW (2009) SUN: top-down saliency using natural statistics. Vis Cognit 17(6):979–1003

    Article  Google Scholar 

  8. Lu Z, Lin W, Yang X, Ong E, Yao S (2005) Modeling visual attention’s modulatory aftereffects on visual sensitivity and quality evaluation. IEEE Trans Image Process 14(11):1928–1942

    Article  Google Scholar 

  9. Yan Q, Xu L, Shi J, Jia J (2013) Hierarchical saliency detection. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1155–1162

  10. Zhou J, Jin Z (2013) A new framework for multiscale saliency detection based on image patches. Neural Process Lett 38(3):361–374

    Article  Google Scholar 

  11. Yang C, Zhang L, Lu H, Ruan X, Yang MH (2013) Saliency detection via graph-based manifold ranking. In: Proceedings of the international conference on computer vision and pattern recognition

  12. Zhou J, Jin Z, Yang J (2012) Multiscale saliency detection using principle component analysis. In: Proceedings of the joint international conference on neural networks (IJCNN), pp. 1–6

  13. Gopalakrishnan V, Hu Y, Rajan D (2010) Random walks on graphs for salient object detection in images. IEEE Trans Image Process 19(12):3232–3242

    Article  MathSciNet  Google Scholar 

  14. Chang KY, Liu TL, Chen HT, Lai, SH (2011) Fusing generic objectness and visual saliency for salient object detection. In; 13th IEEE international conference on computer vision (ICCV), pp. 914–921

  15. Liu T, Yuan Z, Sun J et al (2011) Learning to detect a salient object. IEEE Trans Pattern Anal Mach Intell 33(2):353–367

    Article  Google Scholar 

  16. Lu S, Mahadevan V, Vasconcelos N (2014) Learning optimal features for salient object detection. In: Proceedings of the international conference on computer vision and pattern recognition

  17. Achanta R, Estrada F, Wils P, Süsstrunk S (2008) Salient region detection and segmentation. In: Proceedings of the 6th international conference on computer vision systems, pp. 66–75

  18. Xie Y, Lu H, Yang M (2013) Bayesian saliency via low and mid-level cues. IEEE Trans Image Process 22(5):1689–1698

    Article  MathSciNet  Google Scholar 

  19. Margolin R, Tal A, Zelnik-Manor L (2013) What makes a patch distinct? In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1139–1146

  20. Borji A, Itti L (2013) State-of-the-art in visual attention modeling. IEEE Trans Pattern Anal Mach Intell 35(1):185–207

    Article  MathSciNet  Google Scholar 

  21. Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259

    Article  Google Scholar 

  22. Bruce N, Tsotsos J (2006) Saliency based on information maximization. In: Advances in neural information processing systems, pp. 155–162

  23. Oliva A, Torralba A, Castelhano M, Henderso J (2003) Top-down control of visual attention in object detection. In: Proceedings of international conference on image processing, pp. 253–256

  24. Zhang L, Tong M, Marks T, Shan H, Cottrell G (2008) SUN: A Bayesian framework for saliency using natural statistics. J Vis 8(7):1–20

    Article  Google Scholar 

  25. Gao D, Mahadevan V, Vasconcelos N (2008) On the plausibility of the discriminant center-surround hypothesis for visual saliency. J Vis 8(7):1–18 13

    Article  Google Scholar 

  26. Guo C, Ma Q, Zhang L (2008) Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1–8

  27. Hou X, Harel J, Koch C (2012) Image signature: highlighting sparse salient regions. IEEE Trans Pattern Anal Mach Intell 34(1):194–201

    Article  Google Scholar 

  28. Achanta R, Hemami S, Estrada F, Susstrunk S (2009) Frequency-tuned salient region detection. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1597–1604

  29. Cheng M et al. (2011) Global contrast based salient region detection. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 409–416

  30. Goferman S, Zelnik-Manor L, Tal A (2012) Context-aware saliency detection. IEEE Trans Pattern Anal Mach Intell 34(10):1915–1926

    Article  Google Scholar 

  31. Gao D, Han S, Vasconcelos N (2009) Discriminant saliency, the detection of suspicious coincidences, and applications to visual recognition. IEEE Trans Pattern Anal Mach Intell 31(6):989–1005

    Article  Google Scholar 

  32. Judd T, Ehinger K, Durand F, Torralba A (2009) Learning to predict where humans look. In: 12th IEEE international conference on computer vision (ICCV), pp. 2106–2113

  33. Jiang H, Wang J, Yuan Z, Wu Y, Zheng N, Li S (2013) Salient object detection: a discriminative regional feature integration approach. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 2083–2090

  34. Christian S, Alexander W, Khalil F, David C, John Z (2013) Statistical textural distinctiveness for salient region detection in natural images. In: Proceedings of the international conference on computer vision and pattern recognition

  35. Shen X, Wu Y (2012) A unified approach to salient object detection via low rank matrix recovery. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 853–860

  36. Mai L, Niu Y, Liu F (2013) Saliency aggregation: a data-driven approach. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1131–1138

  37. Jiang Z, Davis L (2013) Submodular salient region detection. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 2043–2050

  38. Zhou D, Bousquet O, Lal TN, Weston J, Schölkopf B (2004) Learning with local and global consistency. In: Advances in neural information processing systems, vol 16

  39. Bengio Y, Delalleau O, Le Roux N (2006) Label propagation and quadratic criterion. In: semi-supervised learning, pp. 193–216

  40. Achanta R, Shaji A, Smith K et al (2010) SLIC superpixels. Technical report, EPFL. Tech. Rep. 149300

  41. Toet A (2011) Computational versus psychophysical bottom-up image saliency: a comparative evaluation study. IEEE Trans Pattern Anal Mach Intell 33(11):2131–2146

    Article  Google Scholar 

  42. Song L, Mahadevan V, Vasconcelos N (2014) Learning optimal seeds for diffusion-based salient object detection. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 2790–2797

  43. Harel J, Koch C, Perona P (2006) Graph-based visual saliency. In: Advances in neural information processing systems, pp. 545–552

  44. Weijer JVD, Gevers T, Bagdanov AD (2006) Boosting color saliency in image feature detection. IEEE Trans Pattern Anal Mach Intell 28(1):150–156

    Article  Google Scholar 

  45. Wang M, Hua X, Hong R et al (2009) Unified video annotation via multigraph learning. IEEE Trans Circuits Syst Video Technol 19(5):733–746

    Article  Google Scholar 

  46. Lanckriet GRG, Cristianini N, Bartlett P, Ghaoui LE, Jordan MI (2002) Learning the kernel matrix with semidefinite programming. J Mach Learn Res 5(1):27–72

    MathSciNet  MATH  Google Scholar 

  47. Boyd S, Vandenberghe L (2004) Convex optimization. Cambridge University Press, Cambridge

    Book  MATH  Google Scholar 

  48. Alexe B, Deselaers T, Ferrari V (2010) What is an object? In: Proceedings of the international conference on computer vision and pattern recognition, pp. 73–80

  49. Alpert S, Galun M, Basri R, Brandt A (2007) Image segmentation by probabilistic bottom-up aggregation and cue integration. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1–8

  50. Lu Y, Zhang W, Lu H, Xue X (2011) Salient object detection using concavity context. In: 13th IEEE international conference on computer vision (ICCV), Barcelona, Spain

  51. Lu Y, Zhang W, Jin C, Xue X (2012) Learning attention map from images. In: Proceedings of the international conference computer vision and pattern recognition, Providence, USA

Download references

Acknowledgments

This work is sponsored by the Natural Science Foundation of the Jiangsu Higher Education Institutions of China (Grant No. 14KJB520006), the CICAEET fund and the PAPD fund, the Liu Da Talent Peak Project of Jiangsu (2013DZXX023), Jiangsu 333 Project (BRA2013208).

Author information

Authors and Affiliations

  1. Faculty of Computer Engineering, Huaiyin Institute of Technology, Huai’an, 223003, People’s Republic of China

    Jingbo Zhou, Yongfeng Ren, Yunyang Yan & Li Pan

  2. College of Computer and Information, Hohai University, Nanjing, 211100, People’s Republic of China

    Yongfeng Ren

  3. Nanjing University of Information Science & Technology (NUIST), Nanjing, 210044, People’s Republic of China

    Jingbo Zhou

Authors
  1. Jingbo Zhou
    View author publications

    Search author on:PubMed Google Scholar

  2. Yongfeng Ren
    View author publications

    Search author on:PubMed Google Scholar

  3. Yunyang Yan
    View author publications

    Search author on:PubMed Google Scholar

  4. Li Pan
    View author publications

    Search author on:PubMed Google Scholar

Corresponding author

Correspondence to Jingbo Zhou.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, J., Ren, Y., Yan, Y. et al. A Multiple Graph Label Propagation Integration Framework for Salient Object Detection. Neural Process Lett 44, 681–699 (2016). https://doi.org/10.1007/s11063-015-9488-4

Download citation

  • Published:

  • Issue date:

  • DOI: https://doi.org/10.1007/s11063-015-9488-4

Keywords