In study of surveillance, we can see many reports on human detection and tracking using image. In such study, a single camera with a lens of standard field of view is generally used as image input device. If the surveillance system has a large observation area, it needs an omni-directional vision sensor or the camera with a fish-eye lens. The authors describe on an image processing method for human tracking individually in omni-directional space of camera, using the fish-eye image. In this paper, the method using our model for human tracking is explained, and a result of an experiment, which is performed to verify the efficacy of the method, is shown.