Service composition is an emerging way to provide the value-added service. For most existing composition results are rather unstructured and flat, it is very difficult to reuse them. In this paper, we propose two kinds patterns to construct the hierarchy of the composition. This method can not only improve the abstract level of the composition results, but also can promote their reusability. The experiment results and analysis show it is effective.