A Motion Adaptive Wavelet-Denoising for Frame-Rate Up-Conversion

Abstract:

This study introduces a frame-rate up-conversion method that uses a temporal wavelet zerotree-based shrinkage algorithm over motion trajectory of a video obtained by optical flow. The method starts by optical flow estimation for predicting initial estimates of inserted frame pixels. Then, the predicted frame pixels are denoised using a specific wavelet-based algorithm, where each pixel location is examined independently through its own temporal motion path. The denoising was performed by shrinking zero-tree footprints to remove temporal oddities. The resulting video was observed to have more fluent temporal flow as compared to optical flow - only interpolation.

• Periodical: Applied Mechanics and Materials (Volume 850)
• Pages: 121-128
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.850.121
• Online since: August 2016
• Authors: Sukru Gorgulu*, Omer Nezih Gerek
• Keywords: Denoising, Frame Rate Up-Conversion, Symmetric Optical Flow, Wavelet Zerotree

References

[1] L. Guo, O. C. Au, M. Ma, and Z. Liang, Temporal Video Denoising Multihypothesis Motion Compensation, IEEE Trans. Circuits and Systems for Video Technology, Oct. 2007, vol. 17, no. 10.

DOI: 10.1109/tcsvt.2007.903797

[2] V. Zlokolica, A. Pizurica, and W. Philips, Recursive Temporal Denoising and Motion Estimation of Video, IEEE Int. Conf. Image Processing (ICIP), Oct. 2004, vol. 3, pp.1465-1468.

DOI: 10.1109/icip.2004.1421340

[3] S.M.M. Rahman, M.O. Ahmad, and M. N. S. Swamy, Video Denoising Based on Inter-frame Statistical Modeling of Wavelet Coefficients, IEEE Trans. Circuits and Systems for Video Technology, Feb. 2007, vol. 17, no. 2, pp.187-198.

DOI: 10.1109/tcsvt.2006.887079

[4] H. Cheong, A. M. Tourapis, J. Llach, and J. Boyce, Adaptive Spatio-Temporal Filtering for Video De-noising, IEEE Int. Conf. Image Processing (ICIP), Oct. 2004, vol. 2, pp.965-968.

DOI: 10.1109/icip.2004.1419461

[5] N. Rajpoot, Z. Yao, and R. Wilson, Adaptive Wavelet Restoration of Noisy Video Sequences, IEEE Int. Conf. Image Processing (ICIP), Oct. 2004, vol. 2, pp.957-960.

DOI: 10.1109/icip.2004.1419459

[6] P. L. Dragotti, and M. Vetterli, Wavelet Footprints: Theory, Algorithms, and Applications, IEEE Trans. Signal Processing, May 2003, vol. 51, no. 5.

DOI: 10.1109/tsp.2003.810296

[7] J. M. Shapiro, Embedded Image Coding Using Zerotrees of Wavelet Coefficients, IEEE Trans. Signal Processing, Dec. 1993, vol. 41, no. 12.

DOI: 10.1109/78.258085

[8] L. L. Rakêt, L. Roholm, A. Bruhn, and J. Weickert, Motion compensated frame interpolation with a symmetric optical flow constraint, Advances in Visual Computing, Springer Lecture Notes in Computer Science, 2012, vol. 7431, pp.447-457.

DOI: 10.1007/978-3-642-33179-4_43

[9] G. Dane, and T. Q. Nyugen, Motion Vector Processing For Frame Rate Up Conversion, IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), May 2004, vol. 3, pp.309-312.

DOI: 10.1109/icassp.2004.1326543

[10] B. T. Choi, S. H. Lee, Y. J. Park, and S. J. Ko, Frame Rate Up-Conversion Using The Wavelet Transform, Int. Conf. On Consumer Electronics, ICCE 2000, June (2000).

DOI: 10.1109/icce.2000.854566