An autonomous underwater vehicle (AUV) is developed to explore and patrol in underwater environments. To accomplish these objectives, an autonomous navigation and control system is essential to an AUV. An intelligent navigation system produces safe paths from the start point to the target point by itself, and the control system makes the vehicle follow the planned path. In this paper, we propose an autonomous navigation and control system for AUVs based on reinforcement learning scheme.