As one of the constituent elements of a city's character, building color has become a global concern. Munsell color system is a commonly applied tool for city’s building color planning. However, this study applies a new approach--HSB frequency analysis. Through analyzing the data from on-site investigation, HSB frequency analysis bases on the three elements of the Munsell color system and color database of Photoshop for achieving a high quality building color choice and thus providing a standard for a city’s character. This paper uses HSB frequency analysis method to discuss the evolution and problems of building color in Changsha Yuelu Hill University City and explore the characteristics of it. The purpose is to give suggestions of the construction color planning and controlling.