Intelligent video and image analysis technology has been paid much attention recently. But how to effectively evaluate the performance of intelligent video and image analysis methods remains a meaningful and challenging task, which involves many aspects, such as constructing reasonable datasets, developing efficient evaluation tools, designing effective evaluation metrics. We focus on the area of public security and build an Intelligent Video and Image Analysis Evaluation Platform for Public Security (IVIAEPPS). This paper introduces some existing works on building this platform, as well as a video and image challenge based on it. We conclude the paper with some discussions on future works.