Moving objects tracking in video sequences are the fundamental and challenging research topics in computer vision area at present. They have great research and application values in modern industry, military, avigation and spaceflight area. But so far robust object tracking is still an open problem especially when the scene is complex. The main obstacles in the research are the scale of object, occlusion, background complexity and other non-rigid deformation. The system presents an integration of Kalman prediction  and Mean-shift  tracking method. A large number of experimental results show that the proposed tracking algorithm not only can improve the reliability and accuracy which traditional tracking algorithm cannot, but also can improve the real-time performance which SIFT tracking algorithm fails.