This paper proposes applying Option-based hierarchical reinforcement learning algorithm to timetable scheduling strategy learning in colleges and universities so as to enhance the performance of traditional reinforcement learning course-scheduling algorithm. From experimentation and application in course-scheduling system, it can be seen that Option-based hierarchical reinforcement learning course scheduling algorithm has a better effect than traditional reinforcement learning course-scheduling algorithm.