The 3GPP LTE system has been premeditated to offer extensively higher data rates, higher system throughput, and lower latency for delay critical services. This enhanced performance has to be provided and assured under various mobility circumstances. But, an inappropriate setting of input parameter such as hysteresis margin will lead to an extensive number of handover failures. Hence, handover and its performance are of high importance to ensure the continuity of successful calls. This paper investigates the performance of the handover procedure in 3GPP LTE, in terms of handover failure. System level simulations within a typical urban propagation environment, with different User Equipment (UE) speeds and cell radii had been performed. Simulation results show that decreasing cell's size and lower speed of UE will lead to a lower number of handover failures. Furthermore, the optimum hysteresis margin is between 4 dB and 4.5 dB for each case.