Yami, an aboriginal tribe, lives in the Orchid Island, Taitung County. Primary school teachers who teach math in the Orchid Island have been concerning Yami children's learning problems about math. This article aims to explore, from a cultural viewpoint, the reasons why Yami children have math learning problems. A brief introduction of Yami culture is first stated. Then text followed was divided into three parts: "the apprehension of relationships", "the apprehension of symbolisation" and "motivation about math learning: cultural aspects." The author believes that Yami people should have no problems with the apprehension of relationships. However, after reviewing literature about the relationship between math learning/processing and cultural features, the author proposed that Yami children's math failure might have something to do with the complexity of number anmes, the lack of written language, the lack of monetary system/transaction, and the attitude of parent toward children's schollding. Discussion and suggestions were provided at the end of the article.