The research purpose of this paper is to build a platform for image processing, which can be used to minimize and intelligentize the video image processing system, and make it applicable in various and complicated situations. During the design, related data in broad area has been searched, video processing systems of various engineering vehicles are used as reference, the merits and demerits of different methods are analyzed, then the FPGA-based program is chosen. FPGA-based image acquisition PCB is designed in this paper, the working mode is configured and the acquisition controlling module is programmed. Under the control of the controlling module, image data is stored in SRAM correctly. An arm module is also designed according to ARM theory and timing relation, which is used for the reading of image data and fitness algorithm of the road mark line. Finally the complete program of the video tracking system used for the 900T transporting girder vehicle is programmed. The above research validated that this system is totally qualified for large-scale engineering vehicles' video surveillance and safety precaution, which can be used in various engineering vehicles' controlling system, and has a broad prospect.