Virtual assembly based on the virtual reality gives a low-cost and rapid prototyping method for products’ assembly, and tolerances have become a key technique of information integration in CAD/CAM. It will be a new task about how to integrate tolerances into virtual assembly. A toleranced product model based on the virtual reality is constructed for the virtual assembly, and the essential data is saved and managed in database. Model transform interface software is developed, which is a special software that users can get the essential data without any users’ acting. The geometric model of products is constructed in the virtual reality, and the method of getting assembly information, dimensions, and tolerances is proposed. A toleranced product modeling system based on the virtual reality is developed, and the using of tolerances is discussed by an example.