Mosaic of UAV Aerial Video by Integrating Optical Flow Computation and Fourier-Mellin Transformation

Abstract:

UAV Video is rapidly emerging as a widely used source of imagery for many applications in recent years. This paper presents our research on the mosaic of UAV video for the purpose of harbor surveillance. First, one new framework on estimating video frame transformation with Optical flow is presented in this paper. For this new framework, fewer number of Gaussian pyramid is created for implementing for the multiresolution approach and thus, more details for optical flow computation is well kept; Second, we make a discussion on using Fourier-Mellin Transformation in image frequency domain to estimate initial motion parameter of adjacent video frames and with those initial motion parameters, small displacements for optical flow computation can be achieved; The experimental results demonstrated that the mosaic image generated from aerial video shows satisfied visual quality and its surveillance application for fast response to time-critical event, e.g., flood, is descried.

• Periodical: Applied Mechanics and Materials (Volumes 556-562)
• Pages: 4352-4356
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.556-562.4352
• Online since: May 2014
• Authors: Jun Wu*, Ming Cheng Luo, Jun Li
• Keywords: Aerial Video Mosaic, Fourier-Mellin Transformation, Optical Flow, UAV

References

[1] D. Cooper, T.P. Pridmore and N. Taylor: Towards the recovery of extrinsic camera parameters from video records of sewer surveys. Machine Vision and Applications, 11. 2 (1998), pp.53-63.

DOI: 10.1007/s001380050090

[2] J. Wu, Z. Dong, Z. Liu, G. Zhou: Geo-registration and Mosaic Of UAV Video for Quick-Response to Forest Fire Disaster. The fifth SPIE international symposium on multispectral image processing and pattern recognition (2007).

DOI: 10.1117/12.748824

[3] A. Angel, M. Hickman, D. Chandnani and P. Mirchandani, Application of Aerial video for Traffic Flow Monitoring and Management. Proceedings of ISPRS (International Society for Photogrammetry and Remote Sensing), Commission I, Vol. 12. 4(2003).

DOI: 10.1061/40632(245)44

[4] A. Shastry, R. Schowengerdt: Airborne video registration for visualization and parameter estimation of traffic flows. Pecora 15/Land Satellite Information IV/ISPRS Commission I/FIEOS Conference Proceedings (2002).

[5] R. Kumar, S. Samarasekera, S. Hsu, K. Hanna: Registration of highly-oblique and zoomed in aerial video to reference imagery. Proceedings of the 15th International Conference on Pattern Recognition (2000), pp.303-307.

DOI: 10.1109/icpr.2000.902919

[6] H. Shum, R. Szeliski: Construction of panoramic image mosaics with global and local alignment. International Journal of Computer Vision, 44. 2 (2001), pp.151-152.

DOI: 10.1007/978-1-4757-3482-9_13

[7] R. Szeliski: Image alignment and stitching: A tutorial. Foundations and Trends in Computer Graphics and Computer Vision, 2. 1 (2006).

DOI: 10.1561/0600000009

[8] N. Rebiere, M. F. Auclair-Fortier, F. Deschenes: Image mosaicing using local optical flow registration. 19th International Conference on Pattern Recognition(2008).

DOI: 10.1109/icpr.2008.4761522

[9] O. Faugeras, Q. T. Luong and T. Papadopoulo The Geometry of Multiple Images. Cambridge, Massachusetts: The MIT Press (2001).

[10] B.K. Horn and B.G. Schunck: Determining Optical Flow. Artificial Intelligence, 17 (1981).

[11] Q. Chen, M. Defrise, F. Deconinck, Symmetric phase-only matched filtering of Fourier-Mellin transforms for image registration and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16. 12 (1994), pp.1156-1168.

DOI: 10.1109/34.387491

[12] G. Wolberg, S. Zokai: Robust image Rregistration using log-polar transform. Proceedings of International Conference on Image Processing (2000), pp.493-496.

DOI: 10.1109/icip.2000.901003

[13] Z.T. Yu, L. C Nu. Principles of Survey Measurement. Press of Publishing House of Surveying and Mapping. Beijing. 1982 (In China).