Underwater acoustic channel (UAC) is one of the most challenging communication channels in the world, owing to its complex multi-path and absorption as well as variable ambient noise. Although adaptive equalization could effectively eliminate the inter-symbol interference (ISI) with the help of training sequences, the convergence rate of equalization in sparse UAC decreased remarkably. Besides, channel estimation algorithms could roughly figure out channel impulse response and other channel parameters through several specific mathematical criterions. In this paper, a typical channel estimation method, least square (LS) algorithm, is applied in adaptive equalization to obtain the initial tap weights of least mean square (LMS) algorithm. Simulation results show that the proposed method significantly enhances the convergence rate of the LMS algorithm.