Multimodal interface is a human-centered interface. It is the point which is going to communicate with a computer by the system similar to communicating with man. It has the advantage which can choose suitable input-output method in the environment with restrictions in a specific interface. Also it can obtain a high reliability through the fusion of two or more input-output device. However, although there are many input-output modalities, the application using this is very little. Maybe, one of the reasons is the lack of a framework to support development of multimodal applications. This paper presents a design of multimodal interface framework (MMIF). The proposed multimodal interface framework enable rapid development of applications using a variety of modalities.