We demonstrate a quantum memory using the optical phonon modes of room-temperature diamond [1, 2]. The memory stores THz-bandwidth single photons produced by parametric down-conversion for several picoseconds and offers operations upon the stored light.