The realization of object recognition is discussed, the intrinsic relation between factors through high step association analysis is presented to mine the various features using property related analysis, the sensitive recognition features are chosen to improve the recognition efficiency. A multi-agent object recognition model(MAORM) is established, which combines concurrency research results and the specific characteristics of multi-sensor remote sensing image recognition. A majority-decision algorithm based on multi-agent is proposed. Experiment results show the system can effectively identify the bridges, wharfs, ships and so on. Compared with a single remote sensing image, the system can distinguish targets with higher recognition.