Construction of the pavement has consumed a huge amount of high grade aggregates, such as basalt, limestone etc. In some region, these aggregates are very scarce and have to be produced and transported from far aggregate quarries which would cause the waste of energy and resources as well as the increase of cost. Large quantities of gneiss exist in China, the use of gneiss as aggregates might help meet the highway constructing demands and save. In this paper, the feasibility is analyzed with respect to different aspects. Physical properties of gneiss aggregate were evaluated using Los Angeles abrasion, specific gravity and flakiness index. Mixture properties were characterized in terms of Marshall stability, moisture susceptibility, soak wheel track and low temperature cracking resistance property. Experiment results indicate that the physical properties of gneiss aggregates can satisfy the related specifications and these gneiss materials as aggregates can be used in asphalt pavement. Results also show that the optimal gradation component of the mixture consists of the gneiss as coarse aggregate and the limestone as fine aggregate. The use of hydrated lime can improve the moisture susceptibility of the mixtures containing gneiss aggregates.