Panoramic Vision System for Autonomous Driving Vehicle

Abstract:

High effective vision system is important for autonomous driving vehicles. A panoramic vision system based on FPGA+DSP with 6-camera for intelligent vehicles is presented in this paper. The system includes digital image acquisition module and high image processing module which work independently to each other. The including two C6416 DSP chips and one high-performance Virtex-4 FPGA to achieve the complex real-time image processing during autonomous driving, such as cylindrical panoramic image rebuilding, lane detection and tracking. The proposed algorithm was also optimized according to the specific characteristics of the hardware for high parallel processing in FPGA and pipelined in DSP.

• Periodical: Applied Mechanics and Materials (Volumes 644-650)
• Pages: 497-501
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.644-650.497
• Online since: September 2014
• Authors: Yu Bin Zhou*
• Keywords: Autonomous Driving, DSP, FPGA, Intelligent Vehicle, Panoramic Vision

References

[1] LI Li, JIN Hua, CHEN Zhijun and etc. High resolution image data acquisition system based on FPGA and DSP, Journal of Data Acquisition & Processing, Vol. 23, No. 1(2008), pp.117-122.

[2] ZHOU Xianbo, FENG Longling, A study on image acquisition technology based on DSP and FPGA, Optical Technique, Vol. 32(Suppl)(2006), pp.141-143.

[5] QIAN Bo, LIU Yuan-tao, ZHONG Ming. Design of dual-buffer ZBT SRAM controller for the high-speed digital signal processing. Transactions of Shenyang Ligong University. Vol. 27, No. 2 ( 2008), pp.40-43.

[6] CHEN Xing-yao, WANG Zhen-hua, TIAN Jin-wen and etc. Design of a ZBT SRAM controller for high speed remote sensing image compression system. Microelectronics & Computer, Vol. 22, No. 3(2005), pp.46-49.

[7] CHEN Wang, XU Wei, ZHANG Maojun and etc. View Synthesis Based On Cylindrical Panoramic Images. Signal Processing. Vol. 26, No2 (2010), p.184~189.

[8] LV Li, FAN Tanghuai1, WANG Xin and etc. An algorithm for generating cylindrical panoramic image based on double projecting in images with single view. Journal of Nanchang Institute of Technology. Vol. 32, No. 6 (2013), p.12~16.

[9] ZUO Yi, CHEN Yong. YOU Hua. A Fast SIFT Image Mosaic Algorithm Based on Wavelet Transformation. Journal of Chongqing Normal University (NaturalScience). V ol. 31. No. 3(2014), p.12~16.

[10] Miguel Ángel García Garrido, Miguel Ángel Sotelo and etc. Fast Road Sign Detection Using Hough Transform for Assisted Driving of Road Vehicles. 10th International Conference on Computer Aided Systems Theory(EUROCAST 2005). Vol. 3643( 2005), pp.543-548.

DOI: 10.1007/11556985_71

[11] Vincent Voisin, Manuel Avila, Bruno Emile and etc. Advanced Concepts for Intelligent Vision Systems. 7th International Conference Advanced Concepts for Intelligent Vision Systems (ACIVS 2005). Vol. 3708(2005), pp.76-83.

DOI: 10.1007/11558484_10

[12] Amit Bhati, R.K. Somani. Partition based Hough Transformation for Real Time Road Lane Detection. International Journal of Electronics and Computer Science Engineering (IJECSE), Vol. 2, No. 4(2012), pp.1117-1122.

[13] J.C. McCall, M.M. Trivedi, Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation, IEEE Transactions on Intelligent Transportation Systems, Vol. 7, Issue-1(2006), pp.20-37.

DOI: 10.1109/tits.2006.869595