Hybrid discriminant analysis (HDA) can overcome small sample problems and outperform PCA and LDA by unifying principal component analysis (PCA) and linear discriminant analysis (LDA) in a single framework. However, the existing HDA algorithm can’t extract more discriminant information from dataset, and model parameters are difficult to select. To deal with the above problems, a particle swarm optimal (PSO)-based uncorrelated hybrid discriminant analysis algorithm is presented. The conjugate orthogonal condition is added to optimization problem of HDA, PSO is explored to select optimal HDA parameters and the optimal solution can be achieved by solving eigenvalue problem. Simulation demonstrates merits of the proposed algorithm.