In the last years there has been an increasing interest in the multi-scale mechanics of the materials, i.e. in predicting the macroscopic constitutive response on the basis of the underlying microstructure. At each level of structural hierarchy, one may model the material as a continuum, and the representative volume element problem can be formulated in terms of standard equilibrium and boundary conditions. The overall physical behaviour of these micro-heterogeneous materials depends strongly on the shape, size, orientation, properties and spatial distribution of their microconstituents. For prediction of the macroscopic behaviour of such materials the multi-scale homogenization techniques were developed. As an example of such investigation we develop the hierarchical material model of the chemical vapour infiltrated carbon fiber composites (CFCs) with a unidirectional or random distribution of fibers. The approach based on hierarchical structural modeling can be used to theoretically predict the mechanical parameters of CFCs with different microstructure and to develop virtual materials with prescribed mechanical properties.