In this paper, a new noise removal method for color images is described. In the proposed method, first, a tentative output image in which noise is almost perfectly removed is obtained using the iterative robust switching vector median-based vector ε-filter. Then, the residual components between the input and tentative output images are calculated, and image components constitute edges, corner, and other image details are extracted from the residual components using the correlation characteristic in RGB components. Consequently, a final output is obtained by adding the extracted image components into the tentative output image. The effectiveness of the proposed method is illustrated by some experiments.