Application of Thermal Infrared Imagery in Human Action Recognition


Article Preview

Human action recognition has been widely researched and applied in intelligent visual surveillance fields nowadays. Most work on action recognition has been visible-spectrum oriented over the past decade, while the persistence of visual surveillance system increases the demand for night-time action recognition. This paper deals with the problem of night action recognition using thermal infrared imagery. A novel algorithm based on the human action silhouettes energy histograms is proposed. The algorithm first makes use of the statistical background model and background subtraction method to extract the human action silhouettes, while calculating the silhouette energy images for the action sequences. Then, the histograms of oriented gradients are computed from the silhouette energy images. Finally, the human action is represented by the energy histograms features, and recognized by using the Euclidean distance and nearest neighbor classifier. An infrared human action database was built to provide a foundation for night action recognition. Experimental results using the infrared thermal action data show the effective of this method.



Advanced Materials Research (Volumes 121-122)

Edited by:

Donald C. Wunsch II, Honghua Tan, Dehuai Zeng, Qi Luo




J. F. Li and W. G. Gong, "Application of Thermal Infrared Imagery in Human Action Recognition", Advanced Materials Research, Vols. 121-122, pp. 368-372, 2010

Online since:

June 2010




[1] A. Maadi and X. Maldague. Outdoor infrared video surveillance: A novel dynamic technique for the subtraction of a changing background of IR images. Infrared Physics & Technology, 2006, 49(3): 261-265.


[2] J. Davis and V. Sharma. Background-subtraction using contour-based fusion of thermal and visible imagery. Comput Vis Image Underst, 2007, 106: 162-182.


[3] Congxia Dai, Yunfei Zheng, Xin Li. Pedestrian detection and tracking in infrared imagery using shape and apperance. Comput Vis Image Underst, 2007, 106: 194-204.


[4] A. F. Bobick and J. Davis. The recognition of human movement using temporal templates. IEEE Trans on PAMI, 2001, 23(3): 257-267.

[5] L. Gorelick, M. Blank, E. Schechtman and et al. Actions as space-time shapes. IEEE Transactions on PAMI, 2007, 29(12): 2247-2253.

[6] J. Niebles, H. Wang and L. Fei-Fei Unsupervised learning of human action categories using spatial-temporal words. IJCV, 2008, 79(3): 299-318.


[7] J. Han and B. Bhanu. Human activity recognition in thermal infrared imagery. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, (2005).


[8] C. Schuldt, I. Laptev and B. Caputo. Recognizing human actions: a local SVM approach. International Conference on Pattern and Recognition, 2004: 32-36.


[9] L. Wang and D. Suter. Learning and matching of dynamic shape manifolds for human action recognition. IEEE Transactions on Image Processing, 2007, 16(6): 1646-1661.


[10] B. Bhanu and J. Han. Kinematic-based human motion analysis in infrared sequences. Proceedings of Sixth IEEE Workshop on Applications of Computer Vision, 2002: 208-212.


[11] C. Stauffer and W. Grimson. Adaptive background mixture models for real-time tracking. Proc. Conference on Computer Vision and Pattern Recognition, 1999: 246-252.


[12] F. Suard F, A. Rakotomamonjy, A. Bensrhair and et al. Pedestrian detection using infrared images and histograms of oriented gradients. IEEE Intelligent Vehicles Symposium, 2006: 206-212.