This article introduces an intelligent surveillance distributed system based on TMS320DM642. The system platform has many functions, such as OSD (on screen display), analog video output, digital video output, Hard Disk, Ethernet and so on. DM64. User can set the rules via the management software. The video input from analog cameras and IP cameras can be processed by DM642 according to the rules. If any event happens which acts against the rules, alarm will be given. The system provides immediate, accurate and intelligent services for users. In order to realize the complex image processing algorithms on DM642, we optimize the algorithms based on DSP and propose a series of rapid image processing algorithms. The design of the project puts the emphasis on the feasibility of distributed high-performance processing from both hardware and software aspects, which may be easily applied to other large scale or hard real-time intelligent information processing.