In this paper, we consider a heterogeneous pre-test estimator which consists of the two-stage hierarchial information (2SHI) estimator and the Stein-rule (SR) estimator. This estimator is called the pre-test 2SHI (PT-2SHI) estimator. It is shown analytically that the PT-2SHI estimator dominates the SR estimator in terms of mean squared error (MSE) if the parameter values in the PT-2SHI estimator are chosen appropriately. Moreover, our numerical results show that the appropriate PT-2SHI estimator dominates the positive-part Stein-rule (PSR) estimator.