This paper proposes a new state-regularized (SR) and QR decomposition based recursive least squares (QRRLS) algorithm with variable forgetting factor (VFF) for recursive coefficient estimation of time-varying autoregressive (AR) models. It employs the estimated coefficients as prior information to minimize the exponentially weighted observation error, which leads to reduced variance and bias over traditional regularized RLS algorithm. It also increases the tracking speed by introducing a new measure of convergence status to control the FF. Simulations using synthetic and real speech signals show that the proposed method has improved tracking performance and reduced estimation error variance than conventional TVAR modeling methods during rapid changing of AR coefficients.