This paper proposes separating confusion line method in Lab color space using color segmentation for protanopia and deuteranopia. It uses hue information, we segment regions that grouped by neighborhood pixels with similar color information. For this, we use region growing method, so we pick seed points that could be selected pixels, which is peaking at points in after applying the low pass filter in the histogram. Furthermore, for CVD(Color Vision Deficiency)'s making confusion line Map, we made 512 virtual boxes in RGB color space, so that we can classify boxes in same confusion line easily. After this we check whether the regions place in same confusion line or not, and it performs the color transformation in Lab color space to make all of neighboring regions be placed in diverse confusion line so that we can give the best effect of color classification for CVD. Furthermore, we apply this algorithm in the smart phone so that we provide our algorithm to protanopia and deuteranopia easily.