Based on fast multipole boundary element method (FM-BEM) and mixed variational inequality, a new method named mixed fast multipole boundary element method (MFM-BEM) was presented in this paper. In order to improve calculation time and accuracy, incompatible elements as interpolation functions were used in the algorithm. Elements were optimized by mixed incompatible elements and compatible elements. On the one hand, the difficult to satisfy precise coordinate was avoided which caused by compatible elements; on the other hand, the merits of MFM-BEM were retained. Through analysis of example, it was conclusion that calculation time and accuracy were improved by MFM-BEM, calculation continuity was also better than traditional FM-BEM. With increasing of degree of freedom, calculation time of MFM-BEM grew slower than the time of traditional FM-BEM. So MFM-BEM provided a theoretical basis for solving large-scale engineering problems.