luster is an important surface property of the fabric material. Even if the same weave and color of the fabrics, the different appearances could be exhibited when the fabrics are made from different materials. In this paper, we analyzed the different characteristics of pictures taken from real yarns made from different fibers (mainly cotton, bast, silk and wool), and extracted the brightness distribution properties of the pictures. For the yarn luster is highly dependent on the material, we used the method of Shepard interpolation to fit the brightness characteristics of the yarns, so as to set up the specific fitting function. Such fitting function was used to simulate the real texture of the yarn. At the same time, we use the factor of elliptic lighting model to revise the yarn brightness in the fabric. Experiment results show that the method deduced in this paper could exhibit the different appearances of the yarns, and obtain a relative real simulation of the fabric.