In this paper, we proposed a new approach for image clustering to address the adverse effects of noise presented in the images. In particular, the concept of information gain has been incorporated into classical fuzzy c-means (FCM) algorithm in order to develop a robust clustering method. FCM is associated with high sensitivity to noise and produces non-homogenous clustering. To induce robustness to noise, the new clustering technique updates fuzzy membership values and cluster centroids based on information gain. The proposed method produces more homogeneous clustering and its performance can be verified at noisy and noise free images. Experiments have been performed on synthetic, CT liver images and compared with those of classical FCM and one of its robust variants. Moreover, the proposed algorithm has been validated on a data set of 30 carotid artery ultrasound images. Visual inspection of segmented images and clustering quality measures confirm that the proposed approach outperforms other clustering algorithms in comparison. Quantitative measures, in terms of PC and CE, also lead to similar conclusion. Hence, the proposed algorithm is robust to noise and produces homogenous clustering.