Excellent buildings in different period recording city memory in different phases, they are connected up and irreplaceable respectively. As the important part of cultural heritage, modern relics and representative buildings pass historical information authentically and play a crucial role in providing historic witnesses. They are carrying a large number of Chinese history and culture sequentially ranging from the Ming, Qing Dynasty, Republic of China, the early days of New China, the Cultural Revolution period, the Opening-up Reform to contemporary times. They are either relevant to the major historical events and people, or occupy a certain position in the history of urban development. They are the sections of complete chain of history and culture. Nevertheless, they’re hardly shown on the list of “preserved heritage”. Concurrent with the construction of city, a large number of excellent modern buildings are suffering from demolition and destruction for they were young. Because of our lack of conservation consciousness and actions, many of them are in a devil of hole fragmented. The partially neglect of the conservation of modern cultural heritage is bound to cause the rupture of our tradition and blankness in memory. It is an increasingly urgent trend to save and protect these building heritages without any delay. This paper attempts to discuss the problems of modern relics and representative buildings conservation and improvement of conservation system.