On the basis of research on gesture recognition algorithm to the static gesture as a breakthrough idea of using static gesture recognition to identify the dynamic gestures. Firstly, this paper used Kinect to obatain depth image and RGB color image segmenting a hand. After this, for each frame this paper used the skin color segmentation method to process the image. After extracting the hand images, we used the method of density distribution feature and recognition of fingers.numbers based on the binary images to extract the hand gesture feature, then with pre-established gesture library template matching, the final choice of the closest gesture is the recognition of hand gestures. Experimental results demonstrate the accuracy of the proposed algorithm is higher, and successfully applied to the man-machine finger-guessing game, which made a good user experience.