In the past, the optometry instrument calibrated in diopter and astigmatism were usually performed by using human eyes. However, the larger uncertainty of measurement will be induced while observing the measuring patterns using human eyes. Therefore, based on the ANSI/ISEA Z87.1-2010 standard, this study presents the development of automatic optometry system, which comprises of the machine vision, image analysis and processing, and automatic focus technique without human operation. In addition, the astigmatism measurement can be well completed in the electric moving stage. The experimental results show the automatic optometry system has the high accuracy and good repeatability.