The implementation of multimedia technology in various libraries and museums has become increasingly popular. While much effort has been emphasized on the use technology for providing interactive information, it is necessary to systematically explore and analyze important issues related to the readers and the use of multimedia systems. This article will address interaction from three aspects: (1) The environment; (2) The interactivity of multimedia; and (3) Readers' cognitive processes.