Gene silencing by DNA methylation is well documented and known to be essential for various biological phenomena in many organisms. In contrast, the processes that convert the silent state of a gene whose DNA is methylated and predicted to form facultative heterochromatin to the actively transcribed state remain elusive. In Arabidopsis, recent studies have shown that the DNA glycosylases DEMETER (DME) and REPRESSOR OF SILENCING1 (ROS1) participate in DNA demethylation. DME is necessary for genomic imprinting in the endosperm, while ROS1 is involved in pruning DNA methylation patterns in transposons and genic regions of vegetative tissues. These findings provide us with molecular clues for understanding the underlying mechanisms of DNA demethylation and gene activation. In this review, we will consider and discuss the processes of controlling gene activation through DNA demethylation, which are predicted to include the recognition of target sequences, DNA demethylation, the transformation of the chromatin to the active state, and transcription. Many of these processes remain poorly understood at this stage.