To alleviate the excessive computational burden on topology optimizations, an efficient methodology on topology optimization is proposed. In the proposed methodology, a multi-scale ON/OFF method is designed to avoid using infinite number of decision parameters; and a stochastic approximation method is employed to minimize the computational costs when computing the sensitivity information. Numerical results are reported to showcase the merits of the proposed methodology.