Fast Approach to Video Stabilization Based on Hierarchical Estimation of Global Motion with Parallel Computation

Abstract:

In this article, a fast approach of video stabilization is presented based on haerachical estimmation of global motion and multi-thread parallel computation. At first, the structure-texture decomposition is adopted to tackle the negative effect from illumination changes. Then according to pyramid structure of image texture a hierachical model is built to estimate global motion parameters with least square method. Afterwards Gaussian smoothing method is employed to eliminate error accumulation in motion compensation. Meanwhile the multi-thread parallel computation is used to speed up the processing efficiency so as to achieve a real time performance for videos with 25fps.

• Periodical: Applied Mechanics and Materials (Volumes 738-739)
• Pages: 618-624
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.738-739.618
• Online since: March 2015
• Authors: Yi Ming Lu*, Shi Yin Qin
• Keywords: Global Motion Estimation, Hierarchical Estimation, Motion Compensation, Parallel Computation, Video Stabilization

References

[1] Y. Mileva, A. Bruhn, and J. Weickert. Illumination-robust Variational Optical Flow with Photometric Invariants., Pattern Recognition, (2007), pp.152-159.

DOI: 10.1007/978-3-540-74936-3_16

[2] T. Brox, A. Bruhn, N. Papenberg, and J. Weickert. High accuracy optical flow estimation based on a theory for warping., European Conference on Computer Vision (ECCV), (2004), p.25–36.

DOI: 10.1007/978-3-540-24673-2_3

[3] Bergen J R, Anandan P, Hanna K J, et al. Hierarchical model-based motion estimation" Computer Vision—ECCV, 92, (1992), pp.237-252.

DOI: 10.1007/3-540-55426-2_27

[4] Szeliski R. Video mosaics for virtual environments., Computer Graphics and Applications, IEEE, Vol. 16, (1996), pp.22-30.

DOI: 10.1109/38.486677

[5] Hu, Rong, et al. Video stabilization using scale-invariant features. " Information Visualization, 2007. IV, 07. 11th International Conference. (2007).

DOI: 10.1109/iv.2007.119

[6] R. Szeliski, Image Alignment and Stitching: A Tutorial, Technical Report MSR-TR- 2004-92, Microsoft Corp., (2004).

[7] Y. Wexler, E. Shechtman, and M., Irani, Space-time video completion., Proc. IEEE Conf. Computer Vision and Pattern Recognition, Vol. 1, (2004), p.120–127.

DOI: 10.1109/cvpr.2004.1315022

[8] Farid, Hany, and Jeffrey B. Woodward. Video stabilization and Enhancement., TR2007-605, Dartmouth College, Computer Science, (1997).

[9] Matsushita Y, Ofek E, Ge W, et al. Full-frame video stabilization with motion inpainting,. Pattern Analysis and Machine Intelligence, Vol. 28(2006).

DOI: 10.1109/tpami.2006.141

[10] Wedel A, Pock T, Zach C, et al. An improved algorithm for TV-L1 optical flow, Statistical and Geometrical Approaches to Visual Motion Analysis. (2009), pp.23-45.

DOI: 10.1007/978-3-642-03061-1_2

[11] Rudin L I, Osher S, Fatemi E. Nonlinear total variation based noise removal algorithms,. Physica D: Nonlinear Phenomena, Vol. 60, (1992), pp.259-268.

DOI: 10.1016/0167-2789(92)90242-f

[12] Chambolle A. Total variation minimization and a class of binary MRF models, Energy minimization methods in computer vision and pattern recognition. (2005), pp.136-152.

DOI: 10.1007/11585978_10