In this paper, we combine two kinds of features together by virtue of complex vectors and then use the developed generalized K-L transform (or expansion) for feature extraction. The experiments on NUST603 handwritten Chinese character database and CENPARMI handwritten digit database indicate that the proposed method can improve the recognition rate significantly.