Multi-information Integrated Method for Text Extraction from Videos

Abstract:

Video text provides important semantic information in video content analysis. However, video text with complex background has a poor recognition performance for OCR. Most of the previous approaches to extracting overlay text from videos are based on traditional binarization and give little attention on multi-information integration, especially fusing the background information. This paper presents an effective method to precisely extract characters from videos to enable it for OCR with a good recognition performance. The proposed method combines multi-information together including background information, edge information, and character’s spatial information. Experimental results show that it is robust to complex background and various text appearances.

• Periodical: Advanced Materials Research (Volumes 225-226)
• Pages: 827-830
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.225-226.827
• Online since: April 2011
• Authors: Ai Wen Jiang, Gao Rong Zeng
• Keywords: Character Segmentation, Edge Detection, Overlay Text, Text Extraction

References

[1] Keechul Jung, Kwang In Kim, Anil K. Jain, "Text information extraction in images and video: a survey", Pattern Recognition, Elsevier Ltd, 2004, pp.977-997.

DOI: 10.1016/j.patcog.2003.10.012

[2] David Crandall, Sameer Antani, Rangachar Kasturi, "Extraction of special effects caption text events from digital video", IJDAR, Springer-Verlag, 2003, pp.138-157.

DOI: 10.1007/s10032-002-0091-7

[3] Toshio Sato, Takeo Kanade, Ellen K. Hughes, Michael A. Smith, Shin'ichi Satoh, "Video OCR: Indexing Digital News Libraries by Recognition of Superimposed captions", Multimedia Systems, Springer-Verlag, 1999, pp.385-395.

DOI: 10.1007/s005300050140

[4] S. Antani, D. Crandall, R. Kasturi, "Robust Extraction of Text in Video", Proceedings of ICPR, IEEE, (2000)

DOI: 10.1109/icpr.2000.905537

[5] Qifeng Liu, Cheolkon Jung, Youngsu Moon, "Text Segmentation based on Stroke Filter", Proceedings of the 14th annual ACM international conference on Multimedia, 2006.

DOI: 10.1145/1180639.1180677

[6] J. Freixenet, X. Muňoz, D. Raba, J. Marti, X. Cufi, "Yet Another Survey on Image Segmentation: Region and Boundary information integration", ECCV, Springer-Verlag, 2002.

DOI: 10.1007/3-540-47977-5_27

[7] Silvano Di Zenzo, "A Note on the Gradient of a Multi-Image", Computer Vision, Graghics and Image Processing, vol.33, 1986, pp.116-125.

DOI: 10.1016/0734-189x(86)90223-9

[8] Mancas-Thillou, C.;Gosselin, B.,"Color Text Extraction from Camera-based Images, the Impact of the Choice of the Clustering Distance", ICDAR, Vol. 1, 2005, pp.312-316

DOI: 10.1109/icdar.2005.76

[9] J. Scharcanski, A. N. Venetsanopoulos, "Edge Detection of Color Images Using Directional Operators", IEEE Trans on Circuits and System for Video Technology, Vol.7, No.2, 1997, pp.397-401.

DOI: 10.1109/76.564116