This paper addresses the framework which guided the development of the generic video coding standard MPEG-2 Video (ISO/IEC 13818-2) in MPEG (ISO/IECJTC1/SC29/WG11). The authors were deeply involved in the standard development process and for that purpose we first collected various requirements from a number of applications, typically distribution, storage and retrieval and communication services, and extracted essential items. This requirements information led the MPEG members to collaboratively develop necessary algorithmic elements through the use of an evolving Test Model . The second stage of the work was to investigate how the generic standard should be structured, resulting in the establishment of Profiles and Levels which define subsets of the whole standard to facilitate interworking among different applications as well as assisting practical implementation of the standard. The final stage was to make a plan for verifying the draft standard through testing before its approval.