A low cost and compact pulsed power supply was developed to drive a sliding discharge-based plasma reactor with >15 kV pulsed voltages at repetition rates of multi-kilohertz. In the first stage of the pulsed power generation, a small DC voltage (e.g. 12 V) was converted to 2.5 kV AC at 50 kHz using a commercially available oscillator circuit, followed with an AC-DC conversion into ∼18 kV DC using a four-stage Cockcroft-Walton voltage multiplier. The second stage of the pulse formation of ∼18 kV pulses with a ∼20 ns rise time was achieved using a spark gap-switched, self-regulated capacitive discharging circuit. A sliding discharge reactor was powered with the high voltage pulses with varying pulse repetition rates and pulse voltages. Up to 4 kHz of the pulse repetition rate was tested for the sliding discharge reactor at an average power of 3 W. The ozone production by the compact plasma system as a function of voltage, pulse repetition rate, and gas flow rate is discussed. Utility of the device as plasma chemical reactor was demonstrated with the help of an example of ozone synthesis form air.