The manufacturing quality of an aircraft structure greatly relies on the experienced technician with consistent riveting process. Generally, the cost for training an experienced technician is very high. However, manufacturing defects are still unavoidable due to the human errors. In this paper, a quality inspection system for riveting process by using neural network (NN) was developed. This inspection system is able to monitor the real time process and give the assistance on riveting quality verification for experienced technician.