The microwave properties of nano-scale structures are important in a wide variety of applications in quantum technology. Here we describe a low-power cryogenic near-field scanning microwave microscope (NSMM) which maintains nano-scale dielectric contrast down to the single microwave photon regime, up to 109 times lower power than in typical NSMMs. We discuss the remaining challenges towards developing nano-scale NSMM for quantum coherent interaction with two-level systems as an enabling tool for the development of quantum technologies in the microwave regime.