This paper focuses its analysis on the Song Dynasty poet Lu You's climbing poems. To start with, it studies the geographic meanings of the space where buildings that Lu You climbed were located in by analyzing the images Lu You depicts in his climbing poems. Then it also examines how these meanings effectively deliver the main messages of Lu You's climbing poems, such as longing for hermitage, aspiration for redeeming lost territory, and awareness of misfortunes. On top of that, this paper also interprets the semiotic meanings of the structure itself as space. In order to do that, it introduces the key concepts: middle zone, wandering, and ambivalence. These concepts show how Lu You, who struggles all his life and develops contradictory feelings due to dualistic notions and dilemmas he confronts, applies the innate nature of the structure as a middle zone to vividly express his own thoughts and feelings.