The influence of crystallographic orientation stability on the inhomogeneous deformation on the meso-scale was numerically simulated with the crystal plasticity finite element. The initial microstructures were introduced into the finite element via intra-granular orientation gradient. The results demonstrated that the average orientation for both stable Goss and meta-stable cube oriented grains changed very little in plane strain compression (PSC). And for stable Goss oriented grain, the orientation gradient increased slightly, but for meta-stable cube oriented grain, the orientation gradient increased dramatically. And in spite of the same Taylor factor for both oriented grains, the dissipated averaged energy for cube oriented grain was higher than for Goss oriented grains, and the distribution width of dissipated work in cube oriented grain was also wider than that in Goss oriented grain. Furthermore, there was also strong energy gradient in PSC of cube oriented grain. Both the orientation gradient and energy gradient favor the nucleation of cube grains during recrystallization.