One of the most promising candidates for the construction of ultrahigh-density storage media is low-dimensional atomic-scale magnetic nanostructures exhibiting magnetic bi- or multistability. Here we propose a novel route of locally controlling and switching magnetism in such nanostructures. Our ab initio studies reveal that externally applied electric field can be used for this purpose.