In this project, we address the problem to determine human emotion states automatically using modern day smartphones. Sensor-rich smartphones have opened up the opportunity to unobtrusively collect user behaviour patterns, activity details and infer information about emotion states. Determining human emotion accurately and efficiently to build a scalable system is the major objective of the project. Towards that goal, we plan to develop an emotion detection model leveraging on different information sources present on smartphone.