Digital images provide abundant information for the research of building deformation. However, such information is insufficient for the purpose of accurately measuring a building’s shape. This paper explores the method for restoring a building’s accurate shape from digital images. The relationship between oblique images and facade images can be analyzed to correct the distortion of a building’s facade images. The experimental results show that this practical method can meet the requirement of accurate measurement of a building’s deformation.