An adaptive fuzzy c-means (AFCM) clustering based algorithm was developed and applied to the segmentation and classification of multi-color fluorescence in situ hybridization (M-FISH) images, which can be used to detect chromosomal abnormalities for cancer and genetic disease diagnosis. The algorithm improves the classical fuzzy c-means (FCM) clustering algorithm by introducing a gain field, which models and corrects intensity inhomogeneities caused by microscope imaging system, flairs of targets (chromosomes) and uneven hybridization of DNA. Other than directly simulating the inhomogeneousely distributed intensities over the image, the gain field regulates centers of each intensity cluster. The algorithm has been tested on an M-FISH database that we established, demonstrating improved performance in both segmentation and classification. When compared with other fuzzy c-means clustering based algorithms and a recently reported region-based segmentation and classification algorithm, our method gave the lowest segmentation and classification error, which will contribute to improved diagnosis of genetic diseases and cancers.