Aspheric parts are attracting many researchers’ attention for their excellent optical properties. The commonly used manufacturing technology for aspheric parts are mainly based on dedicated high precision machines, resulting in high cost and restricted application fields. To polish this kind of parts on general CNC machine tools, however, the surface quality improvement is limited due to the problem of force-position coupling. In order to solve this issue, a force-position decoupling control method for abrasive polishing was studied, a corresponding comliant polishing tool system was developed, and the mathematical model of the tool system was established. In addition, a polishing force controller was designed, and the performance of the tool system was numerically simulated. Simulation results showed that the polishing tool system can effectively achieve the tasks of force-position decoupling and the stable control of the polishing force.