We investigated the optical properties of isolated single aggregates of Ag nanoparticles (Ag nanoaggregates) on which rhodamine 6G molecules were adsorbed to reveal experimentally a correlation among plasmon resonance Rayleigh scattering, surface-enhanced resonance Raman scattering (SERRS), and its background light emission. From the lack of excitation-laser energy dependence of background emission maxima we concluded that the background emission is luminescence, not Raman scattering. The polarization dependence of both SERRS and background emission was the same as that of the lowest-energy plasmon resonance maxima, which is associated with a longitudinal plasmon. From the common polarization dependence, we identified that the lowest-energy plasmon is coupled with both SERRS and background emission. In addition, we revealed that the lowest-energy plasmon with a higher quality factor (Q factor) yields larger SERRS and background emission intensity. Also, we identified that the Q factor dependence of the SERRS intensity was similar to that of the background emission intensity. This similarity directly supported us to demonstrate an enhancement of both SERRS and background emission by coupling with a common plasmon radiative mode.