Single-molecule imaging and spectroscopy using an aperture scanning near-field optical microscope operating at 1.8 K in a helium bath cryostat is demonstrated. From near-field images at constant excitation frequency, the orientation of single molecules can be deduced. Spectral information is obtained using both near-field and confocal excitation schemes by scanning the excitation frequency at a fixed sample position. Differences between near-field and confocal spectra are discussed in terms of the position with respect to the aperture and the molecular orientation.