Segmentation is fundamental step in video surveillance system. It is hard to segmented interesting object in all environments due to the similarity features of objects and background. The segmentation results (foregrounds) are often broken. An approach composition of some methods including GMM, removing cast shadow, clustering and segmentation broken detection and recovery is proposed to improve the segmentation results. This method is suitable for the applications that the information of bounding boxes is required.