Several different sources of evidence support the idea that visuo-spatial working memory can be segregated into separate cognitive subsystems. However, the nature of these systems remains unclear. Recently we reported data from neurological patients suggesting that information about visual appearance is retained in a different subsystem from information about spatial location. In this paper we report latency data from neurologically intact participants showing an experimental double dissociation between memory for appearance and memory for location. This was achieved by use of a selective dual task interference technique. This pattern provides evidence supporting the segregation of visuo-spatial memory between two systems, one of which supports memory for stimulus appearance and the other which supports memory for spatial location.