A survey was conducted among 281 older adults, to explore the relationship among residence identification, perceived social support and sense of control of the elderly. We used the Residence Identification Questionnaire, Perceived Social Support Scale and Sense of Control Questionnaire, and took a longitudinal design, within an interval of six months. The results showed that: 1) in the elderly’s group, residence identification could positively predict perceived social support; 2) perceived social support could positively predict sense of control; 3) perceived social support could mediate the relationship between residence identification and sense of control. Theoretically, our results proved that the internal mechanism of the effects of residence identification on sense of control is reasonable in the elderly city residents’ group. Practically, our research provided an insight into how we can improve the sense of control of the elderly.