The paper presents a concept of designing a stable time-varying IIR narrow multi-band-stop filter. The proposed structure is based on an all-pass prototype. The stability analysis of the time-varying design is presented. In order to reduce the transient time, the varying rejection bandwidth in time is introduced. The paper also presents the idea of the LUT's (Lookup Table) to control the memory usage of the time-varying filtering structure. The results of the methodology are presented and compared with the stationary counterpart. The proposed stable time-varying filtering structure is applied to the noised test signal in the simulation environment.