Welding is widely used for construction of many structures. It is well known that residual stress is measured on welded joint. In this paper, a new method for reduction of residual stress using ultrasonic vibration during welding is proposed. Two thin plates are butt-welded. When ultrasonic vibration is used on one plate, tensile residual stress is reduced at center of the bead. Second, ultrasonic vibrations with different frequencies are applied on both plates. In this case, reduction rate of residual stress increases. Next, reduction of tensile residual stress is demonstrated by simulation method using an analytical model with dynamic characteristics of welded joint.