The paper discusses how the territorial community is formed through the interaction of the Austronesian village (she) leasehold system and the local knowledge. The system originated from the Dutch era and lasted until the Qing stage. The collective title under the village lease system reflects: the geography of leaseholders' commercial activity, the spatial connection of community, and the spatiality of various inter-village relations. The institution and trading out of the village lease system, which in turn decides the tax system, turns out to be a mechanism affecting the society and culture of the Formosan Plains Astronesians. Through historical survey we can observe how the grouping of Austronesian villages evolved from natural village/tax unit to territorial community and finally being treated as quasi-ethnic groups in the modern era. The process would throw a light on the nature of historical development of Austronesians, as well as the character of their society and culture.