Passive optical networks have shown to be much more attractive than traditional access networks due to their huge bandwidth provisioning. In this paper, we study the issue of QoS service of transmitting video traffic over a passive wavelength division multiplexing (WDM) optical network, which serves as an access network. We explore the possibility of providing an integrated service directly at the WDM optical layer with consideration of the unique QoS requirements from video traffic stream. We introduce a novel multimedia traffic scheduling framework for the QoS service in the WDM passive optical access networks. The simulation results show that the proposed mechanism is capable of providing QoS guarantee for MPEG video applications while achieving high overall throughput.