This paper introduces the design of a DSP-based video image acquisition and real-time processing system. In this paper, as the main embedded processor TMS320DM642 build real-time edge detection hardware platform. TVP5150PBS video decoder is adopted to acquire video signal and data stream ,and CPLD device is configured for system logic Control, achieve real-time video image acquisition and processing. Experiments show that the system can effectively carry out edge detection, to meet the real-time. The research is supported by the Key Laboratory of Nondestructive Test Ministry of Education. The author appreciates the state natural science fund(60577016), Aero-Science fund (2009ZD56008) and province fund (2009GZW00251).