In this paper, an efficient algorithm for implementing Crank-Nicolson scheme in the finite-element time-domain (FETD) method is presented. Based on a direct discretization of the first-order coupled Maxwell curl equations, this algorithm employs edge elements (Whitney 1-form) to expand the electric field and face elements (Whitney 2-form) for the magnetic field. Since the curl of an edge-element is the linear combination of those face elements whose faces contain the given edge, only the Maxwell-Ampere equation composes a sparse linear matrix equation for the electric field update; the Maxwell-Faraday equation is explicit. The Crank-Nicolson scheme is implemented leading to an unconditionally stable vector FETD method and the matrix inverse is not required to be computed explicitly. Therefore, only one matrix equation is required to be solved at each time step. Numerical results demonstrate that the proposed method is efficient when compared with the conventional leap-frog mixed FETD method and the Crank-Nicolson FDTD method.