Tracking and registration of camera and object is one of the most important issues in Augmented Reality (AR) systems. Markerless visual tracking technologies with image feature are used in many AR applications. Feature point based neural network image matching method has attracted considerable attention in recent years. This paper proposes an approach to feature point correspondence of image sequence based on transient chaotic neural networks. Rotation and scale invariant features are extracted from images firstly, and then transient chaotic neural network is used to perform global feature matching and perform the initialization phase of the tracking. Experimental results demonstrate the efficiency and the effectiveness of the proposed method.