The development of deformation texture and microstructure was examined for four different initial textures. IF steel sheets with a majority of α-, ε-, and γ-fiber and near random texture were prepared and cold rolled. The specimens exhibited characteristic behaviors in rolling texture evolution and deformation-induced misorientation development, according to their initial textures, especially at small strain levels. Due to the orientation dependence of intra-granular misorientation accumulation, the different texture evolutions affected the induced misorientation distribution. A larger fraction of γ-fiber orientations was related to more prominent misorientation development, while the initial texture stability simultaneously affected the misorientation development. The unstable, initial ε-fiber texture showed a stronger tendency of misorientation accumulation than the stable α-fiber during the subsequent cold rolling.