This paper analyzes and introduces the design process of an Embedded Streaming Media Server. The hardware composition and the software architecture of the system are elaborated. According to the real-time transmission requirements of the audio and video streaming of multimedia, a real-time stream media server is designed based on the RTP/RTCP protocol. The system of streaming media server takes advantage of low power consumption and high performance of ARM11 embedded processor, and makes use of the linux kernel as the embedded development platform which is easy to customize for a particular application. The streaming media server adopts concurrent server algorithm. The realization of code is based on the UDP protocol communication model of the socket network programming which is under the environment of linux. The system is fault-tolerant with high performance and the loss rate of the packet is also low. The server designed is especially suitable for the mobile video monitoring application.