In this paper, we consider a bootstrap approximation to the distribution of the least squares estimator of the autoregressive parameter β in a first-order autoregressive process which may or may not have a stationary solution. Our bootstrap procedure is a modification of the standard bootstrap and employs a data based shrinkage towards the critical values β = ±1.The error in estimation of the sampling distribution of by the above procedure converges to zero as the sample size grows, irrespective of the value of the autoregressive parameter. This result is in sharp contrast with the behavior of the standard bootstrap for which a random limiting distribution emerges at the critical values β = ±1, resulting in a failure of the bootstrap procedure. The asymptotic validity of our procedure enables us, inter alia, to construct a confidence interval for β which will have the correct coverage probability (asymptotically) under any real β.The theoretical validity result for the modified bootstrap is supported by appropriate simulations. Finally, we also indicate an extension of the proposed modified bootstrap method to thep th order autoregressive processes.