Displacement measurement can be performed with high accuracy using phase-shifting method. In phase-shifting method, it is often used four steps of phase-shifting for one cycle. In conventional method, to measure the displacement of an object by an interferometer, the phase of a reference beam should be shifted by every π/2 in the four-step phase-shifting. In this paper, a phase-shifting method with unknown intervals is proposed. This method does not need to shift a phase by every π/2. It can detect an intensity distribution and a phase distribution from five fringe images with equal intervals even if the phase-shift amount is unknown. Using this method, we propose a displacement measurement of phase-shifting digital holographic interferometry using spherical wave as reference wave.