We consider the multiple regression model Y = X 0 β + , where Y and aren -vector random variables, X 0 is an n m design matrix and β is an m-vector of unknown regression parameters. It is well known that different information theoretic criteria with proper choice of penalty function can be used to choose the correct model. In this paper we have done an extensive simulation study to choose the proper penalty function, by using different models and using different error random variables.