Social learning theory expects the social worker to hold more favorable beliefs about elderly people and scapegoat theory expects one having higher self-esteem to be so. The role of social work and self-esteem may be factors explaining ageism at the individual level. Because ageism seems to emerge in Hong Kong as well as other industrialized societies, the study surveyed the general public, social workers, students, elderly center members to (1) determine the relative extent of ageism in terms of beliefs about physical, social, and psychological dimensions of elderly people, and (2) test hypotheses deriving from social learning and scapegoat theories. Analysis of data from 902 respondents showed that people younger than 60 years were more favorable regarding the social dimension and less favorable regarding the psychological dimension of beliefs about elderly people. One with higher self-esteem tended to be more favorable in beliefs about social and psychological dimensions of elderly people but less favorable in the belief about the physical dimension. Although the gerontological social worker was more favorable in the belief regarding the social dimension of elderly people than others, this difference might be attributable to his or her higher self-esteem. Hence the role of social work did not necessarily improve one's image of elderly people in Hong Kong.