In order to construct a constitutive model taking into the effect of both the fabric tensors and their evolution modes, this paper links modern ideas of thermomechanics opinion to the theory of fabric tensors. The anisotropic dissipation incremental function of modified Cam-clay constitutive model considering the effect of fabric characteristic can be obtained by establishing the relation between microstructure and plastic volume strain. After discussing the yield surfaces in the dissipative and the true stress space from the viewpoint of the evolution mode of the fabric tensors, the results indicate that the slope of the normal consolidation line and the critical state line will be governed by changes of void fabric. The model successfully captures most salient behaviors of granular materials related to fabric issues. In the dissipative stress space, the void of granular materials can rearrange and show more anisotropic. In the true stress space, fabric not only affects the deflection of the yield surface, but also affects the hardening rule.