A reinforcement learning method is proposed that can utilize parts of states and their partial symmetries to solve a problem efficiently. In most cases the action selection does not need considering all the states but only needs looking at parts of states or restricted state of corresponding action. Moreover, restricted states of different actions are symmetrical, and thus the action value function based on restricted states can be shared which further reduces the reinforcement learning problem size. The method is compared, in terms of simulation results and other aspects, with other standard reinforcement learning methods.