In this paper, a fabric defect detection method based on Gabor filter bank is present. In this method, the parameters of Gabor filter bank depend on the fabric texture feature. Using the Gabor filter bank with multi-frequency and multi-orientation, a textile image produces multi-image. Then, the images are reconstructed into one image for detecting defects. It is illustrated that most kinds of defects are correctly detected and segmented. The experimental results show that the algorithm is robust and has good detection effect.