The IEEE 802.16e system supporting mobility on fixed wireless-MAN systems is supposed to be a mobile broadband wireless access (BWA) and evolve into 4G mobile communication systems. Although the system already defines its own mobility management algorithm, a network layer handover algorithm should be defined to support the mobility of mobile stations in the Internet. There are many active researches on how to apply the L3 handover protocol over the existing IEEE 802.16e L2 handover scheme, but most of the previous works have focused on the timing of L3 handover messages over the IEEE 802.16e L2 handover messages. In this paper, we propose a new handover scheme for fast mobile IPv6 over the IEEE 802.16e system. By integrating FMIPv6 with IEEE 802.16e system efficiently, the proposed scheme can minimize not only L3 handover latency but also packet losses.