Humans are capable to produce thousands of facial actions during communication that vary in intensity, complexity and meaning. The purpose of this paper is to recognize the human emotions in terms of happy, sad, surprise, neutral and disgust. Its aim is to recognize the facial expression stored in a database. It uses a set of single static image with different expression labels as the training database. The purposed system depends upon the human face, as we know face also reflects the human brain activities or emotions. In this paper, the neural network has been used for better results. In the end of the paper comparisons of existing Human Emotion Recognition System has been made with new one.