Depth-image-based-rendering (DIBR) has received much attention in recent years as a promising technology for 3DTV systems. However, holes are inevitable in DIBR during the view synthesis procedure because the scene area, which has been occluded in the reference image, become visible in the synthesized virtual view. In this paper, we propose dictionary based hole filling with the assistance of depth. Because holes generally come from background area, we first segment background from foreground with the assistance of depth. Then, we construct a dictionary for hole filling from background. Finally, we employ the dictionary to fill holes in the synthesized virtual view. Experimental results demonstrate that the proposed method achieves good performance in hole filling in terms of visual quality and quantitative measures.