Tracking of objects or image region undergoing nonrigid transformation is a challenging and central problem of computer vision. It gets further complicated when the object/region to be tracked is similar to other nearby objects/regions or background. This paper presents a Region Of Interest(ROI) tracking approach based on Maxwell's demon based image registration algorithm. This approach doesn't require features of an object/region to be extracted, but rather works only on the pixel intensities. This enables it to be suitable for tracking object/region undergoing non-rigid transformations and having little contrast with the background. The extensibility of the current approach to more complex problems like multiple ROI tracking and to handle almost any arbitrary changes in ROI is evident. We demonstrate the proposed non-rigid ROI tracking algorithm using endoscopy video data which is one of the potential applications of proposed algorithm.