Mode decision process in multi-view video coding (MVC) consumes a large amount of coding time. To reduce the mode decision complexity, an adaptive early termination (AET) algorithm of fast mode decision based on mode correlation within temporal and inter-view frames is proposed in this paper. Experimental result demonstrates that, compared with TZ-fast-search (TZFS) scheme adopted by JMVC7.2, the proposed algorithm reduces the coding time consumption by over 80% with acceptable video quality degradation.