By taking into account the regenerative chatter vibration, a nonlinear dynamics model for high speed ball-end milling is proposed. The effect of dynamic components of milling forces on chatter is analyzed. A method to predict the stability limits of high speed ball-end milling process is proposed and the stability lobes diagram is simulated. The comparison of experimental milling forces with the simulation results indicates the high accuracy of the model and the effectiveness of the simulation algorithms. The proposed method provides a theoretical instruction for parameters selection and optimization in milling processing.