In order to improve the efficiency of video information storage of the video surveillance system, this paper proposes a mechanism based on buffer and anomaly detection algorithm for video storage. The algorithm uses anomaly detection mechanism, only stored anomaly video, and uses buffer mechanism to completely store exception video information. Compared with the current algorithm, while maintaining the integrity of the video information it can effectively save the video storage space and improve video surveillance system of video storage efficiency.