This paper introduces a pose invariant face recognition method with a training image and a query image using 3D morphable model and neural network. Our system uses 3D morphable model to get the reconstructed 3D face from the training image and obtains 2D image patches of facial components from the 3D face under varying head pose. The 2D image patches are used to train a neural network for pose invariant face recognition. Because those patches are obtained from the varying head pose, the neural network has robustness in the query image under the different head pose form the training image. Our pose invariant face recognition system has the performance of correct recognition higher than 98% with BJUT 3D scan database.