In this paper, we propose an Advanced Soft Remote Control System so as to endow the users with the ability to control various home appliances instead of individual remote controller for each appliance and to command naturally at various places without being conscious of the view direction of the cameras. Through the developed system, the user first selects the device that he/her wants to control by pointing it with his/her hand. Then, the user can command operation of the desired functions via 10 predefined basic hand motion commands. By the experiment, we can get 97.1% recognition rate during offline test and 96.5% recognition rate during online test. The developed system complements some inconveniences of conventional remote controllers specially by giving additional freedom to persons with movement deficits and people without disabilities.