Obstacle detection based on stereovision is sensitive to illumination. Considering phase congruency is insensitivity to illumination, the paper presents a novel algorithm for color image stereovision obstacle detection based on phase congruency. The images are segmented with phase congruency and color in the algorithm, firstly. The obstacles are detected after stereo correspondence of segmentation images. The result of experiment indicates that the algorithm is good at image segmentation and obstacle detection under varying illumination.