An emerging machine learning technique, the support vector machine (SVM), based on statistical learning theory is very good at analyzing small samples and non-linear regression problem. The particle swarm optimize (PSO) can avoid the man-made blindness and enhance the efficiency and capability in forecasting. In this paper, SVM is applied to establish a model for asphalt pavement performance evaluation, optimized by PSO algorithm. In road engineering, PCI, SSI, SRI and IRI were selected as the asphalt pavement performance evaluation indexes, but it is difficult to get pavement condition index. This paper describes the relationships among the four indicators, and SSI, SRI and IRI were used for establishing the prediction model to forecast PCI based on PSO-SVM. The results show that the method is simple and effective for evaluation of asphalt pavement performance.