From the perspective of cultural ecology,the natural environment,economic conditions,traditional culture,production methods and life style have a profound impact on people’s cultural choices. The record of a Muslim family ’s struggle against poverty clearly shows that poverty, in a cultural sense, is not actually homogeneous. Drawing on the research methods from oral history and regional social history,this paper explores the historical logic of the changes of cultural background of poor families,which would help to break the vicious circle of"the poorer,the less educated and the less educated,the poorer",and improve the theoretical system of precise cultural poverty alleviation.