Many new control techniques and energy dissipation systems which can decrease the response of wind vibration and earthquake. But there is less research on the mixed control system of Damper and TMD. In order to improve the shortcomings of Damper system and TMD system, combining their respective advantages reasonably, the mixed control system of Damper and TMD were analyzed in this paper. A 20-storey Benchmark model was used to compare the effects of various control systems under 2-directional earthquake. Taking the displacement reducing coefficient (DRF) as the objective function, Damper system, TMD system, and the mixed control system of Damper and TMD are optimally designed based on Genetic Algorithm (GA). Numerical results show that the mixed control system of dampers and TMD proposed in the paper can work in coordination and complement each other to achieve better control effect.