As a basic aspect of computer vision, reliable tracking of multiple objects is still an open and challenging issue for both theory studies and real applications. A novel multi-object tracking algorithm based on multiple cameras is proposed in this paper. We obtain the foreground likelihood maps in each view by modeling the background using the codebook algorithm. The view-to-view homographies are computed using several landmarks on the chosen plane. Then, we achieve the location information of multi-target at chest layer and realize the tracking task. The proposed algorithm does not require detecting the vanishing points of cameras, which reduces the complexity and improves the accuracy of the algorithm. The experimental results show that our method is robust to the occlusion and could satisfy the real-time tracking requirement.