Segmentation of video objects is very important for video objects detection or tracking. A simple segmentation approach for sport scene images is proposed in this paper. Firstly, a simple method is applied to detect the interest pixels in images by the defined interest pixels extraction function; Secondly, all the detected interest pixels neighbored each other are grouped to object interest regions; after that, the non-interest pixels in interest region are changed to interest pixels by inner filling method; Thirdly, the binarized images can be easily segmented applying simple edge detection algorithms or contour tracing approaches. Several images captured from sport scene are used to test the proposed algorithm, the result indicate that the approach is valid and feasible.