Relying solely on their works and viewing their choices as individual cases, one might think that the attitude of Ming yimin 遺民 toward the problem of taking office or withdrawing from public life under Qing rule was a simple matter. However, if we analyze these cases with reference to factors of kinship and group-relationship, they become much more complicated . This paper concentrates on Wei Xi’s 魏禧 political choice and those of family members such as his brothers and nephews, in order to illustrate that the decisions made by Wei’s clan as to serving the Qing during the Ming-Qing transition were not as simple as many people tend to think. Moreover, it is also argued that previous studies, which treat Wei’s eremitism as an individual case and praise his uncompromising loyalty to the Ming, not only over-simplify the issue but are also unfair to those who sacrificed themselves for the yimin’s insistence on their loyalty to Ming. On the whole, this paper advances the view that treating the yimin’s political choices as individual cases prevents us from realizing the complexity of the time, the difficulties of the yimin in preserving their moral integrity, the subtle relationship between taking office or withdrawing from public life during a period of dynastic change, and the sacrifice of those who took office for those who withdrew from the public.