This paper proposes a new method to realize the track correlation of Radar and ESM. Firstly, the coarse correlation rule is set up via the first-order Taylor series expansion and a coarse association function based on the geometry of radar and ESM. Then, the fine correlation matrix is set up by accumulating the historical information of the coarse correlation matrix. It is found that the coarse correlation threshold is only related with ESM measurement error. Finally, the simulation results show that the new proposed algorithm can effectively improve the correlation performance.