For pseudo-linear regression identification models corresponding output error systems with colored measurement noises, a difficulty of identification is that there exist unknown inner variables and unmeasurable noise terms in the information vector. This paper presents an auxiliary model based multi-innovation extended stochastic gradient algorithm by using the auxiliary model method and by expanding the scalar innovation to an innovation vector. Compared with single innovation extended stochastic gradient algorithm, the proposed approach can generate highly accurate parameter estimates. The simulation results confirm this conclusion.