A 2-dimensional vertex dynamics simulation is applied to the annealing behaviour of deformed Aluminium single crystals having different orientations. It is observed in experiments that deformed single crystals of different orientations - typically the common rolling textures like Goss (110), Brass (110)[1-12], Cube (001) – exhibit remarkably different rates of recovery. It is suggested that this difference arises from the deformation microstructures, with sub-grain boundaries of various misorientation values. The sub-grain boundary mobilities and energies, being strong functions of the boundary misorientation, thus affect the recovery rates. This effect is illustrated using vertex dynamics simulation on the same orientations and schematic deformation substructures as above. Good agreement is obtained for the orientation dependency of recovery.