A Spatio-Temporal Video Segmentation Method Based on Motion Detection

Abstract:

In the paper, a new spatio-temporal segmentation algorithm is proposed to extract moving objects from video sequences, the sequences were taken by stationary cameras. First, the motion detection is used to achieve the mask representing moving regions with a estimation noise parameter. Which can effectively improve noise immunity. Due to the shortage of the moving video object textures, the eight-neighbor motion detection is present, which is used to smooth the mask boundary and fill the interior holes. Then a morphological filter is applied to refine the moving mask. Second, spatial segmentation is detected by the Canny operator. Then utilize the gradient histogram to select the high threshold to increase the adaptivity of Canny algorithm. Finally, merge the temporal and spatial mask by neighborhood matching algorithm to ensure further reliability and efficiency of our algorithm. Experiments on typical sequences have successfully demonstrated the validity of the proposed algorithm.

• Periodical: Applied Mechanics and Materials (Volumes 135-136)
• Pages: 1147-1154
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.135-136.1147
• Online since: October 2011
• Authors: Jin Wang, Zhao Hui Li, Dong Mei Li, Yu Wang
• Keywords: Eight-Neighbor Motion Detection, Spatial Segmentation, Spatio-Temporal Fusion, Temporal Segmentation

References

[1] Haifeng Lu. A Novel Automatic Motion Segmentation Method based on Optical Flow[J].2010 IEEE

[2] F.Meyer and S.Beucher,"Morphological segmentation,"J. VisualCommun. Image Represent.,vol.1, no.1, p.21–46, Sept. 1990.

[3] A.Elgammal,R.Duraiswami,D.Harwood, and L. S. Davis, "Background and foreground modeling using nonparametric kernel density estimation for visual surveillance," Proc. IEEE, vol. 90, pp.1151-1163, 2002.

DOI: 10.1109/jproc.2002.801448

[4] Guo J,Kim J W,Kuo C C J.Fast and accurate moving object extraction technique for MPEG-4 object-based video coding[A].In:Proceedings of SPIE[C],Boston，Massachusetts,USA,1999,3653:1210—1221.

DOI: 10.1117/12.334628

[5] Mech R,Wollborn M.A noise robust method for 2D shape estimation of moving objects in video sequence considering a moving camera[J].Signal Processing,1998,66(2):203—217.

DOI: 10.1016/s0165-1684(98)00006-1

[6] J.G. Choi S.W. Lee S.D. Kim.Spatio-temporal video　segmentation　using　a　joint　 similarity　measure.　IEEE　Trans.Circuits and　Systems　for　Video　Technology,vol.7,pp.279-286,Apr, 1997.

DOI: 10.1109/76.564107

[7] I.Kompatsiaris M.G. Strintzis.Spatiotemporal　segmentation　and　tracking　of　objects　for　visualization　of　videoconference　image　sequences.　IEEE　Trans.Circuits　and　Systems　for　Video　Technology,vol.10,pp.1388-1402,Dec.2000.

DOI: 10.1109/76.889030

[8] L.Patras E.A. Hendriks and　R.L. Lagendijk.Video segmentation　by　MAP　labeling　of　watershed　segments.IEEE　Trans.　Pattern　Analysis　and　Machine　Intelligence,vol.23,pp.326-332,2001.

DOI: 10.1109/34.910886

[9] C. Kim and J. Hwang, "Video object extraction far abjcct. oticntcd applications", Juumol o/ YLSl Si&mzal Processing, vol.29, pp.7-1, (2001)

[10] Meier T,King :Video segmentation for content-based coding[J].IEEE Transactions on Circuits and System for Video,(1999)

[11] Aach T,Kaup A,Mester R.Statistical model-based change detection in moving video[J]．Signal Processing,1993,31(2):165—180

DOI: 10.1016/0165-1684(93)90063-g

[12] R. Thoma and M Bierling, "Motion compensating interpolation considering covered and uncovered background", Signal Processing: Image Communication, Yol.I, No.2, October 1989, pp.191-212.

DOI: 10.1016/0923-5965(89)90009-x

[13] Whalen AD.Detection of signals in noise[M].New York andLondon:Academic Press,(1971)

[14] J.Cany,"A computational approach to edge detection,"IEEE Trans.Pattern Anal.Machine Intell.,vol.PAMI-8,pp.679-698,Nov.(1986)

DOI: 10.1109/tpami.1986.4767851

[15] Xin Weiwang,"A spatio-temporal method based on edge detection",Journal of Information Engineering University,vol. 2,June,(2007)