A visual-based autonomous motion planning algorithm is designed to guide the robot to take the elevator autonomously. The floor chosen operation as well as the path planning and motion control for the robot’s in-out elevator are the two critical issues. A visual-based motion regulation method is proposed in this paper, so is a manipulator motion planning algorithm based on image Jacobian Matrix. Fuzzy logic is used to mobile path planning. Experimental results on humanoid service robot proves the validity of this control system.