Ghosts are figuratively roaming in J. M. Coetzee’s well-known postcolonial novel, Waiting for the Barbarians, which is set in an undefined time full of strife and unrest. In the novel, being mysterious and threatening to the Empire, the barbarians represent the spectral others. This paper is concerned with the question of how to approach the figurative ghosts of the barbarians and deal with their haunting when they usually appear in a horrified, irrational or obscure way. I will suggest that the concept of a medium, which refers to a person who acts as go-between between the living and the spiritual world, can be used more figuratively as an attitude that presupposes a mode of negotiation through which a person approaches the spectral other and establishes a mutual understanding with it. In addition, I will argue that the protagonist, the Magistrate, plays the role of “passive medium,” which refers to a person who originally belongs to the class of the authorities, or is restricted to the dominant cognitive frame, but is haunted by the foreignness of the repressed other and forced to establish identification with this ghostly other. By examining how the Magistrate experiences his emotional and social ambivalence in his encounter with his inner otherness as well the external otherness, I investigate how the concept of passive medium functions productively to challenge the hierarchy between the Empire and the barbarians, self and other, and to re-imagine a dialogic world to come.