In this paper, we present an image defogging algorithm with color correction in the HSV color space for video processing. We first detect the atmospheric region from the saturation (S) channel in the HSV color space, and estimate atmospheric light in the atmospheric region. We also generate a transmission map using a weighting parameter computed from the intensity (V) values. The proposed method can significantly enhance the visibility of foggy video frames using the estimated atmospheric light and the transmission map with consideration of temporal correlation of consecutive frame. Another contribution of the proposed work is the compensation of color distortion between consecutive frames using the temporal difference ratio of H and S channels. Experimental results show that the proposed method can be applied to consumer video surveillance systems for removing atmospheric artifacts without color distortion.