It is double-buses modularized structure with the combination of system control bus and high speed image data bus which is put forward in this paper. Moreover, the management and distribution of image data bus and the design of system reset procedure are elaborated through which a kind of practical real-time image processing system with the strongest adaptability and capability for structure programming and system expansion. The computing capability in infrared test of small target is greatly improved which is verified in tri DSP model system. According to complex image processing task, through the adjustment of parallel structure of image processing algorithm, the higher parallel efficiency can be realized. So to say, the system structure has a great adjustment to algorithm parallel structure and can be successfully used as a platform for universal real-time image processing.