Subjective memory complaints (SMC) is a possible symptom of mild cognitive impairment which may progress to dementia. The present study examines the relationship of physical activity (PA), cognitive activity (CA), social activity (SA), and perceived health status (HS) with SMC for middle age and older adults. Participants were from the MIDUS II study (Midlife in the United States) recruited in 2004–2006 (Mean age = 55.99; N = 3030). Hierarchical multiple regression was performed with SMC as the dependent variable, along with PA, CA, SA, and HS as the independent variables. The study revealed that SMC was strongly related to PA, CA, and HS, while controlling covariates. Further, HS had the strongest link with SMC among these predictors while interaction effects (PA × HS, CA × HS, and SA × HS) were insignificant. In addition, different results were achieved in younger versus older groups. Participants with more CA, PA and perception of better health had lower frequency of memory complaints.