Two-dimensional (2D) face recognition by correlation is a key challenge of telecommunication and optical information processing. Although this issue has been the focus of intense research, its utilization still has some drawbacks especially when the face is in rotation. In this paper, we propose an alternative method based on a newly designed optical correlation filter which allows recognizing faces with different view angles. This filter called “Multi-View Binary Phase-Only Filter” is based on a double fusion of reference images allowing an optimisation of the use of the spatial-bandwidth product (SBWP) in the filter Fourier plane. The first fusion is performed in the image (space) domain, and the second one is conducted in the spectral domain. Simulations results with the Pointing Head Pose Image Database illustrate the performance of the designed correlation filter for multi-view face recognition.