With the aim to remove the unwanted feature points, template matching algorithm which includes pixel-coherence and fixed structure is proposed in this paper. Corner detection algorithm can extract image feature points with the flexibility for illumination variation and affine transformation. This paper gets the special points of plane image by corner detection algorithm and proposes the problem of existing more useless point. Then, template matching algorithm is used to solve the issue and collects the best match points. Finally, the paper compares the template image and the matched image. The experimental results prove that the feature points by template matching algorithm have excellent accurate characteristic for the illumination, transfer and the rotation transform, and they are highly satisfactory.