With the development of virtual reality technology, using the VR technique to realize landscaping planning and ancient architecture reconstruction has become a hot research and application topic. In this paper, we use VR technique to restored the scene of the famous painting which named " Riverside Scene At Qingming Festival" by Mr. Zeduan Zhang who was a famous painter in Northern Song Dynasty. In construction of the 3D ancient scene model, this paper consultes and analyses many references about the building spatial form of the imperial garden in the Northern Song Dynasty, and put forward the method for constructing the 3D model of ancient architecture. The real-time roaming system is constructed based on the VR Platform Virtools. In addition, we research and implement the stereoscopic displaying in the roaming system by using the shading programming technique of Vritools. Experimental results show that our system provides a very immersive impression for the virtual exhibition of ancient scenes. The modeling method put forward in the paper provides a good reference for the construction of ancient architecture.