close
Skip to main content
Springer Nature Link
Log in

Fast and robust seam estimation to seamless image stitching

  • Original Paper
  • Published:
Save article
View saved research
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Image stitching has a wide range of applications in computer vision/graphics and virtual reality. Seam estimation is one of the key steps in image stitching. This step can relieve ghosts and artifacts that were generated by misalignment or moving objects in the overlap region. This paper presents a fast and robust seam estimation method (FARSE) by defining gray-weighted distance and gradient-domain region of differences to avoid visible seams and ghosting. The optimal seam is estimated by searching in two weighted matrices, namely cost matrix and value matrix. The proposed method could be simply implemented. Results indicate that the FARSE method is scale-invariant and it is fast and more robust than the other methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+
from $39.99 /Month
  • Starting from 10 chapters or articles per month
  • Access and download chapters and articles from more than 300k books and 2,500 journals
  • Cancel anytime
View plans

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

Explore related subjects

Discover the latest articles, books and news in related subjects, suggested using machine learning.

Abbreviations

OR:

Overlap Region

FARSE:

Fast and robust seam estimation.

References

  1. Szeliski, R.: Image alignment and stitching: a tutorial. Found. Trends\(\textregistered \) Comp. Gr. Vis. J. 2(1), 1–104 (2006)

  2. Peleg, S.: Elimination of seams from photo mosaics. Comput. Gr. Image Process. 16(1), 90–94 (1981)

    Article  Google Scholar 

  3. Duplaquet, M.-L.: Building large image mosaics with invisible seam lines, in aerospace/defense sensing and controls. Int. Soc. Opt. Photonics 3387, 369–377 (1998)

    Google Scholar 

  4. Davis, J.: Mosaics of scenes with moving objects. In: Proceedings IEEE Conference on Computer Vision Pattern Recognition, pp. 354–360 (1998)

  5. Fang, X., Zhu, J., Luo, B.: Image mosaic with relaxed motion. SIViP 6(4), 647–667 (2012)

    Article  Google Scholar 

  6. Efros, A. A., Freeman, W. T.: Image quilting for texture synthesis and transfer. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, ser. SIGGRAPH ’01 (341–346). ACM (2001)

  7. Mills, A., Dudek, G.: Image stitching with dynamic elements. Image Vis. Comput. 27(10), 1593–1602 (2009)

    Article  Google Scholar 

  8. Burt, P.J., Adelson, E.H.: A multi resolution spline with application to image mosaics. ACM Trans. Gr. 2(4), 217–236 (1983)

    Article  Google Scholar 

  9. Zeng, L., Zhang, W., Zhang, S., Wang, D.: Video image mosaic implement based on planar-mirror-based catadioptric system. SIViP 8(6), 1007–1014 (2014)

    Article  Google Scholar 

  10. Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. ACM Trans. Gr. 22(3), 313–318 (2003)

    Article  Google Scholar 

  11. Zaragoza, J. Chin, T.-J. Brown, M. S., Suter, D.: As-projective as- possible image stitching with moving DLT. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2339–2346 (2013)

  12. Levin, A. Zomet, A. Peleg, S., Weiss, Y.: Seamless image stitching in the gradient domain. In: Proceedings 8th European conference computer vision, pp. 377–389 (2004)

  13. Irani, M., Anandan, P.: Video indexing based on mosaic representations. Proc. IEEE 86(5), 905–921 (1998)

    Article  Google Scholar 

  14. Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., Cohen, M.: Interactive digital photomontage. ACM Trans. Gr. (TOG) 23(3), 294–302 (2004)

    Article  Google Scholar 

  15. Borgefors, G.: Distance transformations in digital images. Comput. Vis. Gr. Image Process. 34(3), 227–248 (1986)

    Google Scholar 

  16. Danielsson, P.E.: Euclidean distance mapping. Comput. Gr. Image Process. 14(3), 227–248 (1980)

    Article  Google Scholar 

  17. Szeliski, R., Shum, H.-Y.: Creating full view panoramic image mosaics and texture mapped models. In: Proceedings computer graphics (SIGGRAPH’97), pp. 251–258 (1997)

  18. Chen, C. Y., Klette, R.: Image stitching—comparisons and new techniques. In: Computer analysis of images and patterns (CAIP’99), pp. 615–622 (1999)

  19. Uyttendaele, M. Eden, A., Szeliski, R.: Eliminating ghosting and exposure artifacts in image mosaics. In: IEEE Computer society conference on computer vision and pattern recognition (CVPR’2001), pp. 509–516 (2001)

  20. Porter, T., Duff, T.: Compositing digital images. Comput. Gr. (SIGGRAPH’84) 18(3), 253–259 (1984)

    Article  Google Scholar 

  21. Blinn, J.F.: Jim Blinn’s corner: compositing, part 1—Theory. IEEE Comput. Gr. Appl. 14(5), 83–87 (1994)

    Article  Google Scholar 

  22. Wood, D.N., Finkelstein, A., Hughes, JF., Thayer, CE., Salesin, DH.: Multi perspective panoramas for cel animation. In: Computer graphics proceedings, annual conference series, pp. 243–250 (1997)

  23. Peleg, S., Rousso, B., Rav-Acha, A., Zomet, A.: Mosaicing on adaptive manifolds. IEEE Trans. Pattern Anal. Mach. Intell. 22(10), 1144–1154 (2000)

    Article  Google Scholar 

  24. Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Fiume, E. (ed.) SIGGRAPH, Computer Graphics Proceedings, pp. 341–346. ACM Press, New York (2001)

    Google Scholar 

  25. Herley, C.: Automatic occlusion removal from minimum number of images. In: Processing of the International Conference on Image, pp. 1046–1049 (2005)

  26. Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23(11), 1222–1239 (2001)

    Article  Google Scholar 

  27. Gemanand, S., Geman, D.: Stochastic relaxation, Gibbs distribution, and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell. 6(6), 721–741 (1984)

    Article  MATH  Google Scholar 

  28. Sun, J., Zheng, N., Shum, H.: Stereo matching using belief propagation. IEEE Trans. Pattern Anal. Mach. Intell. 25(7), 787–800 (2003)

    Article  MATH  Google Scholar 

  29. Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Gr. 22(3), 277–286 (2003)

    Article  Google Scholar 

  30. Boykov, Y., Kolmogorov, V.: An experimental comparison of mincut/ max-flow algorithms for energy minimization in vision. IEEE Trans. Pattern Anal. Mach. Intell. 26(9), 1124–1137 (2004)

    Article  Google Scholar 

  31. Eden, A., Uyttendaele, M., Szeliski, R.: Seamless image stitching of scenes with large motions and exposure differences. Proc. IEEE Conf. Comput. Vis. Pattern Recogn. 2, 2498–2505 (2006)

    Google Scholar 

  32. Jia, J., Tang, C.-K.: Image stitching using structure deformation. IEEE Trans. Pattern Anal. Mach. Intell. 30(4), 617–631 (2008)

    Article  Google Scholar 

  33. Zhang, G., He, Y., Chen, W., Jia, J., Bao, H.: Multi-viewpoint panorama construction with wide-baseline images. IEEE Trans. Image Process. 25(7), 3099–3111 (2016)

    Article  MathSciNet  Google Scholar 

  34. Gao, J., Li, Y., Chin, T.-J., Brown, M.S.: Seam-driven image stitching. In: Eurographics, pp. 45–48 (2013)

  35. Zhang, F., Liu, F.: Parallax-tolerant image stitching. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3262–3269 (2014)

  36. Lin, K. Jiang, N. Cheong, L.-F. Do, M., Lu, J.: Seagull: Seam-guided local alignment for parallax-tolerant image stitching. In: Proceedings 14th European Conference on Computer Vision, pp. 370–385 (2016)

  37. Li, N. Liao, T., Wang, C.: Perception-based energy functions in seam-cutting. arXiv preprint arXiv:1701.06141 (2017)

  38. Lowe, D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  39. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–95 (1981)

    Article  MathSciNet  Google Scholar 

  40. Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004)

    Book  MATH  Google Scholar 

  41. Soille, P.: Generalized geodesy via geodesic time. Pattern Recogn. Lett. 15(12), 1235–40 (1994)

    Article  Google Scholar 

  42. Rzhanov, Y.: Photo-mosaicing of images of pipe inner surface. Signal Image Video Process. 7(5), 865–871 (2013)

    Article  Google Scholar 

  43. Panorama-Maker. http://www.arcsoft.com/panorama-maker/ (2013). Accessed 11 Aug 2015

  44. ICE. http://research.microsoft.com/en-us/um/redmond/groups/ivm/ice/ (2015) Accessed 23 May 2016

  45. VisualSize. http://www.visualsize.com/; (2011) Accessed 16 May 2015

Download references

Acknowledgements

The research leading to these results has received funding from the Bu-Ali Sina University Research Affairs by Grant Number 32-1178.

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Bu-Ali Sina University, Fahmide St, Hamedan, 6517838695, Iran

    Hadi Hejazifar & Hassan Khotanlou

Authors
  1. Hadi Hejazifar
    View author publications

    Search author on:PubMed Google Scholar

  2. Hassan Khotanlou
    View author publications

    Search author on:PubMed Google Scholar

Corresponding author

Correspondence to Hassan Khotanlou.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hejazifar, H., Khotanlou, H. Fast and robust seam estimation to seamless image stitching. SIViP 12, 885–893 (2018). https://doi.org/10.1007/s11760-017-1231-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Version of record:

  • Issue date:

  • DOI: https://doi.org/10.1007/s11760-017-1231-3

Keywords

Profiles

  1. Hassan Khotanlou View author profile